Max level shown:
1 [ Jun 6 21:17:25 Enabled. ]
2 [ Jun 6 21:17:25 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jun 6 21:17:25 Method "start" exited with status 0. ]
4 [ Jun 6 21:17:25 Rereading configuration. ]
5 [ Jun 6 21:17:25 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-06-06T21:17:25.224ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-06-06T21:17:25.225ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-06-06T21:17:25.276ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-06-06T21:17:25.276ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-06-06T21:17:25.390ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-06-06T21:17:25.399ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-06-06T21:17:25.407ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-06-06T21:17:26.006ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:a02a::, len: 64 }
152024-06-06T21:17:26.146ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-06-06T21:17:26.147ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-06-06T21:17:26.147ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-06-06T21:17:26.147ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-06-06T21:17:26.147ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:506
202024-06-06T21:17:26.147ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:625
212024-06-06T21:17:26.150ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
222024-06-06T21:17:26.150ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:674
232024-06-06T21:17:26.150ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242024-06-06T21:17:26.150ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:733
252024-06-06T21:17:26.150ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
262024-06-06T21:17:26.150ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = None
272024-06-06T21:17:26.150ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
282024-06-06T21:17:26.150ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-06-06T21:17:26.150ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-06-06T21:17:26.162ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:304
312024-06-06T21:17:26.162ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool)
322024-06-06T21:17:26.266ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal }
332024-06-06T21:17:26.471ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
342024-06-06T21:17:26.471ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
352024-06-06T21:17:26.471ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-06-06T21:17:26.471ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-06-06T21:17:26.471ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
382024-06-06T21:17:26.471ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-06-06T21:17:26.471ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-06-06T21:17:26.480ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:304
412024-06-06T21:17:26.480ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool)
422024-06-06T21:17:26.567ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal }
432024-06-06T21:17:26.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
442024-06-06T21:17:26.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
452024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
462024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
472024-06-06T21:17:26.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
482024-06-06T21:17:26.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-06-06T21:17:26.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
502024-06-06T21:17:26.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
512024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
522024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
532024-06-06T21:17:26.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-06-06T21:17:26.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-06-06T21:17:26.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
562024-06-06T21:17:26.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
572024-06-06T21:17:26.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
582024-06-06T21:17:26.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
592024-06-06T21:17:26.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
602024-06-06T21:17:26.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
612024-06-06T21:17:26.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
622024-06-06T21:17:26.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
632024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
642024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
652024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
662024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
672024-06-06T21:17:26.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
682024-06-06T21:17:26.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
692024-06-06T21:17:26.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
702024-06-06T21:17:26.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
722024-06-06T21:17:26.774ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
732024-06-06T21:17:26.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
742024-06-06T21:17:26.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
752024-06-06T21:17:26.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-06-06T21:17:26.774ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
772024-06-06T21:17:26.774ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
782024-06-06T21:17:26.774ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
792024-06-06T21:17:26.774ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
802024-06-06T21:17:26.775ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
812024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
822024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
832024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
842024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
852024-06-06T21:17:26.775ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
862024-06-06T21:17:26.775ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
872024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
882024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
892024-06-06T21:17:26.775ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
902024-06-06T21:17:26.775ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-06-06T21:17:26.775ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
922024-06-06T21:17:26.775ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
932024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
942024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
952024-06-06T21:17:26.775ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
962024-06-06T21:17:26.775ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-06-06T21:17:26.775ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
982024-06-06T21:17:26.775ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:93
992024-06-06T21:17:26.775ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
1002024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1012024-06-06T21:17:26.775ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1022024-06-06T21:17:26.775ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1032024-06-06T21:17:26.775ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
1042024-06-06T21:17:26.775ZINFOSledAgent (bootstore): No ledger in /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-06-06T21:17:26.775ZINFOSledAgent (bootstore): No ledger in /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-06-06T21:17:26.775ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-06-06T21:17:26.775ZINFOSledAgent (bootstore): No ledger in /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-06-06T21:17:26.775ZINFOSledAgent (bootstore): No ledger in /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-06-06T21:17:26.775ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-06-06T21:17:26.775ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
1112024-06-06T21:17:26.775ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
1122024-06-06T21:17:26.786ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:711
1132024-06-06T21:17:26.786ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1514, tv_nsec: 100245990 } time_to_next_cleanup = 599.999906289s
1142024-06-06T21:17:26.786ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3645
1152024-06-06T21:17:26.786ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1162024-06-06T21:17:26.786ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-06-06T21:17:26.786ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-06-06T21:17:26.789ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-06-06T21:17:26.789ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-06-06T21:17:26.790ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV1 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], addresses: [ V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1004
1212024-06-06T21:17:26.790ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-06-06T21:17:26.790ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1232024-06-06T21:17:26.790ZINFOSledAgent (RSS): No ledger in /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-06-06T21:17:26.790ZINFOSledAgent (RSS): No ledger in /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-06-06T21:17:26.790ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1064
1262024-06-06T21:17:26.790ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1272024-06-06T21:17:26.790ZINFOSledAgent (RSS): No ledger in /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-06-06T21:17:26.790ZINFOSledAgent (RSS): No ledger in /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-06-06T21:17:26.790ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1105
1302024-06-06T21:17:26.790ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:118
1312024-06-06T21:17:26.790ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:91
1322024-06-06T21:17:26.790ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1332024-06-06T21:17:26.790ZINFOSledAgent (RSS): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-06-06T21:17:26.790ZINFOSledAgent (RSS): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-06-06T21:17:26.790ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:138
1362024-06-06T21:17:26.790ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1138
1372024-06-06T21:17:26.790ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-06-06T21:17:26.790ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-06-06T21:17:26.791ZINFOSledAgent (bootstore): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-06-06T21:17:26.791ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-06-06T21:17:26.791ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: c0aaf062-8365-4c9f-956d-e354db5eed54, rack_id: 2fb27e2a-d075-4483-ad8e-1f8ffb14ff73, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-06-06T21:17:26.791ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:40674
1432024-06-06T21:17:26.791ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: c0aaf062-8365-4c9f-956d-e354db5eed54, rack_id: 2fb27e2a-d075-4483-ad8e-1f8ffb14ff73, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:360
1442024-06-06T21:17:26.791ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1452024-06-06T21:17:26.791ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1462024-06-06T21:17:26.791ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1472024-06-06T21:17:26.791ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1482024-06-06T21:17:26.791ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1492024-06-06T21:17:26.791ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1502024-06-06T21:17:26.791ZINFOSledAgent (StorageManager): No ledger in /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1512024-06-06T21:17:26.791ZINFOSledAgent (StorageManager): No ledger in /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-06-06T21:17:26.791ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1532024-06-06T21:17:26.791ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1542024-06-06T21:17:26.794ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3877
1552024-06-06T21:17:26.804ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
1562024-06-06T21:17:26.813ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
1572024-06-06T21:17:26.823ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
1582024-06-06T21:17:26.832ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
1592024-06-06T21:17:26.841ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
1602024-06-06T21:17:26.850ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
1612024-06-06T21:17:26.859ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
1622024-06-06T21:17:26.868ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
1632024-06-06T21:17:26.877ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
1642024-06-06T21:17:26.877ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1652024-06-06T21:17:26.877ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1662024-06-06T21:17:26.877ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1672024-06-06T21:17:26.877ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1682024-06-06T21:17:26.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1692024-06-06T21:17:26.881ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:353 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
1702024-06-06T21:17:26.881ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1712024-06-06T21:17:26.881ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:365 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
1722024-06-06T21:17:26.881ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1732024-06-06T21:17:26.887ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 123.738799ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "df9473b6-3b40-4c67-b7fd-582c37b0d9bd", "content-length": "124", "date": "Thu, 06 Jun 2024 21:17:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "df9473b6-3b40-4c67-b7fd-582c37b0d9bd" } file = clients/ddm-admin-client/src/lib.rs:178
1742024-06-06T21:17:26.894ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_7d687f62-3d4a-451a-813f-806af5d7ee6f/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1752024-06-06T21:17:26.898ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1762024-06-06T21:17:26.917ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1772024-06-06T21:17:26.919ZINFOSledAgent: successfully created encrypted zvol: name="oxi_7d687f62-3d4a-451a-813f-806af5d7ee6f/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-06-06T21:17:26.919ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_7d687f62-3d4a-451a-813f-806af5d7ee6f/swap" file = sled-agent/src/swap_device.rs:96
1792024-06-06T21:17:26.924ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:380 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
1802024-06-06T21:17:26.924ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1812024-06-06T21:17:26.924ZINFOSledAgent (BackingFs): Ensuring dataset oxi_7d687f62-3d4a-451a-813f-806af5d7ee6f/backing/fmd file = sled-agent/src/backing_fs.rs:136
1822024-06-06T21:17:26.994ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1832024-06-06T21:17:27.012ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1842024-06-06T21:17:27.013ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 113.39463ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "799f1be2-558a-4e77-a76f-f36b5bddce56", "content-length": "124", "date": "Thu, 06 Jun 2024 21:17:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "799f1be2-558a-4e77-a76f-f36b5bddce56" } file = clients/ddm-admin-client/src/lib.rs:178
1852024-06-06T21:17:27.128ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1862024-06-06T21:17:27.128ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 74.152673ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d76cfe0c-abef-49bb-8286-262efde45e30", "content-length": "124", "date": "Thu, 06 Jun 2024 21:17:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d76cfe0c-abef-49bb-8286-262efde45e30" } file = clients/ddm-admin-client/src/lib.rs:178
1872024-06-06T21:17:27.203ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1882024-06-06T21:17:27.204ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 237.640368ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0e4ed8ab-d901-4ca2-99f4-ac24973fdb2e", "content-length": "124", "date": "Thu, 06 Jun 2024 21:17:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0e4ed8ab-d901-4ca2-99f4-ac24973fdb2e" } file = clients/ddm-admin-client/src/lib.rs:178
1892024-06-06T21:17:27.212ZINFOSledAgent (BackingFs): Mounting oxi_7d687f62-3d4a-451a-813f-806af5d7ee6f/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1902024-06-06T21:17:27.225ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1912024-06-06T21:17:27.225ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1922024-06-06T21:17:27.225ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1932024-06-06T21:17:27.225ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1942024-06-06T21:17:27.443ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1952024-06-06T21:17:27.444ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 256.314556ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b57b6673-3fd4-4dae-9349-7eabbcb1122b", "content-length": "124", "date": "Thu, 06 Jun 2024 21:17:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b57b6673-3fd4-4dae-9349-7eabbcb1122b" } file = clients/ddm-admin-client/src/lib.rs:178
1962024-06-06T21:17:27.702ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1972024-06-06T21:17:27.702ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 178.671444ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d1fa7e11-0194-442d-b119-78ae6ac5d9c7", "content-length": "124", "date": "Thu, 06 Jun 2024 21:17:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d1fa7e11-0194-442d-b119-78ae6ac5d9c7" } file = clients/ddm-admin-client/src/lib.rs:178
1982024-06-06T21:17:27.883ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1992024-06-06T21:17:27.917ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2002024-06-06T21:17:27.917ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:34076 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2012024-06-06T21:17:27.917ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2022024-06-06T21:17:27.917ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:34076 file = oximeter/producer/src/lib.rs:276 interval = 30s producer_id = c0aaf062-8365-4c9f-956d-e354db5eed54 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2032024-06-06T21:17:27.918ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 270.249006ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2042024-06-06T21:17:27.961ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2052024-06-06T21:17:27.961ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2062024-06-06T21:17:27.961ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:993 underlay_address = fd00:1122:3344:101::1
2072024-06-06T21:17:27.961ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2082024-06-06T21:17:27.962ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:12345
2092024-06-06T21:17:27.962ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
2102024-06-06T21:17:27.962ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2112024-06-06T21:17:27.962ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2122024-06-06T21:17:27.962ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2132024-06-06T21:17:27.963ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2142024-06-06T21:17:27.963ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV1 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV1 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None }], addresses: [V4(Ipv4Net { addr: 10.151.2.174, width: 24 })], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2152024-06-06T21:17:27.963ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3645
2162024-06-06T21:17:27.963ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:40674
2172024-06-06T21:17:28.141ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2182024-06-06T21:17:28.141ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2192024-06-06T21:17:28.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2202024-06-06T21:17:28.141ZINFOSledAgent (RSS): No ledger in /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2212024-06-06T21:17:28.141ZINFOSledAgent (RSS): No ledger in /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2222024-06-06T21:17:28.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2232024-06-06T21:17:28.141ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2242024-06-06T21:17:28.145ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2252024-06-06T21:17:28.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46711
2262024-06-06T21:17:28.173ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2272024-06-06T21:17:28.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46711 req_id = 39c15b68-e478-44db-9683-f652d2cd2c98 response_code = 200 uri = /inventory
2282024-06-06T21:17:28.190ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 513.903791ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2292024-06-06T21:17:28.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56525
2302024-06-06T21:17:28.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56525 req_id = 8548431a-e3a1-4411-8ba2-810a7f4cbeeb response_code = 200 uri = /sled-role
2312024-06-06T21:17:28.203ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2322024-06-06T21:17:28.203ZINFOSledAgent (RSS): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2332024-06-06T21:17:28.204ZINFOSledAgent (RSS): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2342024-06-06T21:17:28.204ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:815
2352024-06-06T21:17:28.232ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: 33a56900-2caf-47c3-bff2-b09546524ff9, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, pool_id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool) }, OmicronPhysicalDiskConfig { id: 36a6fefd-ecb4-401f-ae9d-49f73f7c9443, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, pool_id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool) }, OmicronPhysicalDiskConfig { id: 00b0ab94-f4af-47bf-943e-248d3cc75543, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, pool_id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool) }, OmicronPhysicalDiskConfig { id: 0b6bb0f7-9c92-499d-ae20-b4b47f134db2, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, pool_id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool) }, OmicronPhysicalDiskConfig { id: 5475f3d5-2395-4380-9dc9-7ba84dae27a4, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, pool_id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool) }, OmicronPhysicalDiskConfig { id: 18ad720b-7782-4c15-bf5c-e7e9e52e1122, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, pool_id: 0d4507b2-f585-45d8-bb5b-916ef11d551a (zpool) }, OmicronPhysicalDiskConfig { id: 8d7d3f67-14eb-4f95-9073-172fda8e2952, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, pool_id: ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798 (zpool) }, OmicronPhysicalDiskConfig { id: df1c4b8d-8e98-4c69-b92b-4866514236af, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, pool_id: f940f667-095d-47e9-b4e9-c42a00bc2822 (zpool) }, OmicronPhysicalDiskConfig { id: 1c393cfe-3c65-4b6e-b5a7-97020167ba95, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, pool_id: 02a90705-a0f8-48c6-a1ce-d34d36f64f29 (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:348 sled_address = [fd00:1122:3344:101::1]:12345
2362024-06-06T21:17:28.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34097
2372024-06-06T21:17:28.233ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 33a56900-2caf-47c3-bff2-b09546524ff9, pool_id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 36a6fefd-ecb4-401f-ae9d-49f73f7c9443, pool_id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 00b0ab94-f4af-47bf-943e-248d3cc75543, pool_id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 0b6bb0f7-9c92-499d-ae20-b4b47f134db2, pool_id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 5475f3d5-2395-4380-9dc9-7ba84dae27a4, pool_id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 18ad720b-7782-4c15-bf5c-e7e9e52e1122, pool_id: 0d4507b2-f585-45d8-bb5b-916ef11d551a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 8d7d3f67-14eb-4f95-9073-172fda8e2952, pool_id: ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: df1c4b8d-8e98-4c69-b92b-4866514236af, pool_id: f940f667-095d-47e9-b4e9-c42a00bc2822 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 1c393cfe-3c65-4b6e-b5a7-97020167ba95, pool_id: 02a90705-a0f8-48c6-a1ce-d34d36f64f29 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:381
2382024-06-06T21:17:28.233ZINFOSledAgent (StorageManager): No ledger in /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2392024-06-06T21:17:28.233ZINFOSledAgent (StorageManager): No ledger in /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2402024-06-06T21:17:28.233ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2412024-06-06T21:17:28.233ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2422024-06-06T21:17:28.233ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:379
2432024-06-06T21:17:28.233ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2442024-06-06T21:17:28.233ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2452024-06-06T21:17:28.373ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:304
2462024-06-06T21:17:28.373ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool)
2472024-06-06T21:17:28.750ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.288780249s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2482024-06-06T21:17:28.968ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2492024-06-06T21:17:29.374ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }
2502024-06-06T21:17:29.552ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:332
2512024-06-06T21:17:29.552ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:334
2522024-06-06T21:17:29.552ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:338
2532024-06-06T21:17:29.552ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:340
2542024-06-06T21:17:29.552ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2552024-06-06T21:17:29.552ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2562024-06-06T21:17:29.552ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2572024-06-06T21:17:30.118ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2582024-06-06T21:17:30.311ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2592024-06-06T21:17:30.311ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.679096865s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2602024-06-06T21:17:30.311ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2612024-06-06T21:17:30.312ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2622024-06-06T21:17:30.732ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/zone file = sled-storage/src/dataset.rs:395
2632024-06-06T21:17:30.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 70.358232ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2642024-06-06T21:17:31.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 107.007246ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2652024-06-06T21:17:31.501ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2662024-06-06T21:17:32.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 136.724032ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2672024-06-06T21:17:32.228ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.490859699s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2682024-06-06T21:17:32.228ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2692024-06-06T21:17:32.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 255.584255ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2702024-06-06T21:17:32.869ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2712024-06-06T21:17:33.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.000311692s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2722024-06-06T21:17:33.802ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c41774fe-e97b-4da8-a02e-62aed7a76752 file = sled-storage/src/dataset.rs:480
2732024-06-06T21:17:34.023ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2742024-06-06T21:17:34.031ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:477
2752024-06-06T21:17:34.031ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:394
2762024-06-06T21:17:34.031ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:379
2772024-06-06T21:17:34.031ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2782024-06-06T21:17:34.031ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2792024-06-06T21:17:34.256ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:304
2802024-06-06T21:17:34.256ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool)
2812024-06-06T21:17:35.448ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }
2822024-06-06T21:17:35.701ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:332
2832024-06-06T21:17:35.701ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:334
2842024-06-06T21:17:35.701ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:338
2852024-06-06T21:17:35.701ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:340
2862024-06-06T21:17:35.701ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-06-06T21:17:35.701ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-06-06T21:17:35.701ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2892024-06-06T21:17:36.407ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2902024-06-06T21:17:36.891ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.096264553s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2912024-06-06T21:17:36.892ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2922024-06-06T21:17:37.119ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2932024-06-06T21:17:37.607ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/zone file = sled-storage/src/dataset.rs:395
2942024-06-06T21:17:37.845ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2952024-06-06T21:17:38.079ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2962024-06-06T21:17:38.586ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
2972024-06-06T21:17:38.693ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a file = sled-storage/src/dataset.rs:480
2982024-06-06T21:17:38.700ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:477
2992024-06-06T21:17:38.700ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:394
3002024-06-06T21:17:38.700ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:379
3012024-06-06T21:17:38.700ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3022024-06-06T21:17:38.700ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-06-06T21:17:38.709ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:304
3042024-06-06T21:17:38.709ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool)
3052024-06-06T21:17:38.801ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }
3062024-06-06T21:17:38.809ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:332
3072024-06-06T21:17:38.809ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3082024-06-06T21:17:38.809ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3092024-06-06T21:17:38.809ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3102024-06-06T21:17:38.809ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-06-06T21:17:38.809ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-06-06T21:17:38.809ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3132024-06-06T21:17:38.843ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-06-06T21:17:38.847ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
3152024-06-06T21:17:38.851ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/zone file = sled-storage/src/dataset.rs:395
3162024-06-06T21:17:38.964ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 file = sled-storage/src/dataset.rs:480
3172024-06-06T21:17:38.971ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:477
3182024-06-06T21:17:38.971ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:394
3192024-06-06T21:17:38.971ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:379
3202024-06-06T21:17:38.971ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3212024-06-06T21:17:38.971ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222024-06-06T21:17:38.982ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:304
3232024-06-06T21:17:38.982ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool)
3242024-06-06T21:17:39.075ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External }
3252024-06-06T21:17:39.083ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:332
3262024-06-06T21:17:39.083ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:334
3272024-06-06T21:17:39.083ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:338
3282024-06-06T21:17:39.083ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:340
3292024-06-06T21:17:39.083ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-06-06T21:17:39.083ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-06-06T21:17:39.083ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3322024-06-06T21:17:39.120ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-06-06T21:17:39.129ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/zone file = sled-storage/src/dataset.rs:395
3342024-06-06T21:17:39.257ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_be2ad19f-eecd-4c88-9423-9dddb68b99b1 file = sled-storage/src/dataset.rs:480
3352024-06-06T21:17:39.265ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:477
3362024-06-06T21:17:39.265ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:394
3372024-06-06T21:17:39.265ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:379
3382024-06-06T21:17:39.265ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3392024-06-06T21:17:39.265ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402024-06-06T21:17:39.275ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:304
3412024-06-06T21:17:39.275ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool)
3422024-06-06T21:17:39.372ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External }
3432024-06-06T21:17:39.380ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:332
3442024-06-06T21:17:39.380ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:334
3452024-06-06T21:17:39.380ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:338
3462024-06-06T21:17:39.380ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:340
3472024-06-06T21:17:39.380ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-06-06T21:17:39.380ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-06-06T21:17:39.380ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3502024-06-06T21:17:39.418ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512024-06-06T21:17:39.426ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/zone file = sled-storage/src/dataset.rs:395
3522024-06-06T21:17:39.551ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 file = sled-storage/src/dataset.rs:480
3532024-06-06T21:17:39.559ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:477
3542024-06-06T21:17:39.559ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:394
3552024-06-06T21:17:39.559ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:379
3562024-06-06T21:17:39.559ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3572024-06-06T21:17:39.559ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582024-06-06T21:17:39.568ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:304
3592024-06-06T21:17:39.568ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 0d4507b2-f585-45d8-bb5b-916ef11d551a (zpool)
3602024-06-06T21:17:39.659ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 0d4507b2-f585-45d8-bb5b-916ef11d551a (zpool), kind: External }
3612024-06-06T21:17:39.667ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:332
3622024-06-06T21:17:39.667ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:334
3632024-06-06T21:17:39.667ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:338
3642024-06-06T21:17:39.667ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:340
3652024-06-06T21:17:39.667ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-06-06T21:17:39.667ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-06-06T21:17:39.667ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3682024-06-06T21:17:39.702ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-06-06T21:17:39.711ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/zone file = sled-storage/src/dataset.rs:395
3702024-06-06T21:17:39.758ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2331
3712024-06-06T21:17:39.842ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0d4507b2-f585-45d8-bb5b-916ef11d551a file = sled-storage/src/dataset.rs:480
3722024-06-06T21:17:39.847ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
3732024-06-06T21:17:39.849ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
3742024-06-06T21:17:39.851ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:477
3752024-06-06T21:17:39.851ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:394
3762024-06-06T21:17:39.851ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:379
3772024-06-06T21:17:39.851ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3782024-06-06T21:17:39.851ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3792024-06-06T21:17:39.861ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:304
3802024-06-06T21:17:39.861ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798 (zpool)
3812024-06-06T21:17:39.958ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798 (zpool), kind: External }
3822024-06-06T21:17:39.965ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:332
3832024-06-06T21:17:39.965ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:334
3842024-06-06T21:17:39.965ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:338
3852024-06-06T21:17:39.965ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:340
3862024-06-06T21:17:39.965ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872024-06-06T21:17:39.965ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3882024-06-06T21:17:39.965ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3892024-06-06T21:17:40.000ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3902024-06-06T21:17:40.008ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/zone file = sled-storage/src/dataset.rs:395
3912024-06-06T21:17:40.135ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798 file = sled-storage/src/dataset.rs:480
3922024-06-06T21:17:40.143ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:477
3932024-06-06T21:17:40.143ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:394
3942024-06-06T21:17:40.143ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:379
3952024-06-06T21:17:40.143ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3962024-06-06T21:17:40.143ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3972024-06-06T21:17:40.153ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:304
3982024-06-06T21:17:40.153ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = f940f667-095d-47e9-b4e9-c42a00bc2822 (zpool)
3992024-06-06T21:17:40.252ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: f940f667-095d-47e9-b4e9-c42a00bc2822 (zpool), kind: External }
4002024-06-06T21:17:40.260ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:332
4012024-06-06T21:17:40.260ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:334
4022024-06-06T21:17:40.260ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:338
4032024-06-06T21:17:40.260ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:340
4042024-06-06T21:17:40.260ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-06-06T21:17:40.260ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4062024-06-06T21:17:40.260ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4072024-06-06T21:17:40.296ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4082024-06-06T21:17:40.305ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/zone file = sled-storage/src/dataset.rs:395
4092024-06-06T21:17:40.431ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f940f667-095d-47e9-b4e9-c42a00bc2822 file = sled-storage/src/dataset.rs:480
4102024-06-06T21:17:40.439ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:477
4112024-06-06T21:17:40.439ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:394
4122024-06-06T21:17:40.439ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:379
4132024-06-06T21:17:40.439ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
4142024-06-06T21:17:40.439ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4152024-06-06T21:17:40.449ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:304
4162024-06-06T21:17:40.449ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 02a90705-a0f8-48c6-a1ce-d34d36f64f29 (zpool)
4172024-06-06T21:17:40.544ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 02a90705-a0f8-48c6-a1ce-d34d36f64f29 (zpool), kind: External }
4182024-06-06T21:17:40.553ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:332
4192024-06-06T21:17:40.553ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:334
4202024-06-06T21:17:40.553ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:338
4212024-06-06T21:17:40.553ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:340
4222024-06-06T21:17:40.553ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-06-06T21:17:40.553ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242024-06-06T21:17:40.553ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4252024-06-06T21:17:40.589ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4262024-06-06T21:17:40.597ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/zone file = sled-storage/src/dataset.rs:395
4272024-06-06T21:17:40.716ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_02a90705-a0f8-48c6-a1ce-d34d36f64f29 file = sled-storage/src/dataset.rs:480
4282024-06-06T21:17:40.724ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:477
4292024-06-06T21:17:40.724ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:394
4302024-06-06T21:17:40.724ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312024-06-06T21:17:40.724ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 7d687f62-3d4a-451a-813f-806af5d7ee6f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 23979605-f70d-4d65-a562-1e28a51e0b00 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: 0d4507b2-f585-45d8-bb5b-916ef11d551a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: f940f667-095d-47e9-b4e9-c42a00bc2822 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: 02a90705-a0f8-48c6-a1ce-d34d36f64f29 (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4322024-06-06T21:17:40.724ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
4332024-06-06T21:17:40.724ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
4342024-06-06T21:17:40.724ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352024-06-06T21:17:40.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 12492106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:34097 req_id = a4904caf-f458-4caa-922f-9fef5a0a7f4b response_code = 200 uri = /omicron-physical-disks
4362024-06-06T21:17:40.755ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 41233370-3d38-4c23-8d31-93a659252461, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0cadf319-9a32-4627-b62e-a89e29bc1464, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
4372024-06-06T21:17:40.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65045
4382024-06-06T21:17:40.756ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41233370-3d38-4c23-8d31-93a659252461, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4392024-06-06T21:17:40.756ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 41233370-3d38-4c23-8d31-93a659252461, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4402024-06-06T21:17:40.807ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4412024-06-06T21:17:40.807ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: InternalDns }, responder: ... }
4422024-06-06T21:17:40.852ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
4432024-06-06T21:17:40.856ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0cadf319-9a32-4627-b62e-a89e29bc1464, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4442024-06-06T21:17:40.856ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0cadf319-9a32-4627-b62e-a89e29bc1464, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4452024-06-06T21:17:40.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4462024-06-06T21:17:40.905ZINFOSledAgent (ServiceManager): No ledger in /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/omicron-zones.json file = common/src/ledger.rs:188
4472024-06-06T21:17:40.905ZINFOSledAgent (ServiceManager): No ledger in /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/omicron-zones.json file = common/src/ledger.rs:188
4482024-06-06T21:17:40.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4492024-06-06T21:17:40.949ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4502024-06-06T21:17:40.949ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4512024-06-06T21:17:40.949ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4522024-06-06T21:17:41.001ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464 file = illumos-utils/src/zone.rs:315
4532024-06-06T21:17:41.005ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d file = illumos-utils/src/zone.rs:315
4542024-06-06T21:17:41.009ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461 file = illumos-utils/src/zone.rs:315
4552024-06-06T21:17:41.022ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464 file = illumos-utils/src/zone.rs:354
4562024-06-06T21:17:41.026ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d file = illumos-utils/src/zone.rs:354
4572024-06-06T21:17:41.030ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461 file = illumos-utils/src/zone.rs:354
4582024-06-06T21:17:41.846ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
4592024-06-06T21:17:41.854ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/c0aaf062-8365-4c9f-956d-e354db5eed54): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
4602024-06-06T21:17:42.493ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4612024-06-06T21:17:42.493ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4622024-06-06T21:17:42.493ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
4632024-06-06T21:17:42.975ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4642024-06-06T21:17:42.976ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4652024-06-06T21:17:43.455ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4662024-06-06T21:17:43.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d") failed: Property not found. retry in 60.147425ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
4672024-06-06T21:17:43.464ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
4682024-06-06T21:17:43.468ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4692024-06-06T21:17:43.468ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
4702024-06-06T21:17:43.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d") failed: Property not found. retry in 73.942201ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
4712024-06-06T21:17:43.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461") failed: Property not found. retry in 28.399664ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
4722024-06-06T21:17:43.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464") failed: Property not found. retry in 28.157884ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
4732024-06-06T21:17:43.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d") failed: Property not found. retry in 233.042944ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
4742024-06-06T21:17:43.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461") failed: Property not found. retry in 120.820899ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
4752024-06-06T21:17:43.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464") failed: Property not found. retry in 87.247957ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
4762024-06-06T21:17:43.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464") failed: Property not found. retry in 212.023363ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
4772024-06-06T21:17:43.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d") failed: Property not found. retry in 457.655062ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
4782024-06-06T21:17:43.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461") failed: Property not found. retry in 277.523901ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
4792024-06-06T21:17:44.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464") failed: Property not found. retry in 373.443041ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
4802024-06-06T21:17:44.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461") failed: Property not found. retry in 385.988602ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
4812024-06-06T21:17:44.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d") failed: Property not found. retry in 413.789271ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
4822024-06-06T21:17:44.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464") failed: Property not found. retry in 934.565901ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
4832024-06-06T21:17:44.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461") failed: Property not found. retry in 1.137775846s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
4842024-06-06T21:17:44.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d") failed: Property not found. retry in 1.234444376s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
4852024-06-06T21:17:45.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464") failed: Property not found. retry in 1.141358146s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
4862024-06-06T21:17:45.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461") failed: Property not found. retry in 1.322610864s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
4872024-06-06T21:17:45.855ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:a02a::2 exists in switch zone file = sled-agent/src/services.rs:2348
4882024-06-06T21:17:45.855ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4892024-06-06T21:17:46.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d") failed: Property not found. retry in 1.245900256s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
4902024-06-06T21:17:46.399ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fe59:426a file = sled-agent/src/services.rs:2355
4912024-06-06T21:17:46.405ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2416
4922024-06-06T21:17:46.523ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2601
4932024-06-06T21:17:46.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464") failed: Property not found. retry in 505.214377ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
4942024-06-06T21:17:46.765ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2765
4952024-06-06T21:17:46.946ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2480
4962024-06-06T21:17:47.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464") failed: Property not found. retry in 1.488837165s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
4972024-06-06T21:17:47.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461") failed: Property not found. retry in 924.024446ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
4982024-06-06T21:17:47.244ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2515
4992024-06-06T21:17:47.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d") failed: Property not found. retry in 1.426478395s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
5002024-06-06T21:17:47.447ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2815
5012024-06-06T21:17:47.628ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2842
5022024-06-06T21:17:47.846ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2709
5032024-06-06T21:17:48.031ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2509
5042024-06-06T21:17:48.042ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3901 new = [fd00:1122:3344:101::2, ::1] old = [::1]
5052024-06-06T21:17:48.042ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3917
5062024-06-06T21:17:48.042ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
5072024-06-06T21:17:48.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461") failed: Property not found. retry in 1.164707937s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
5082024-06-06T21:17:48.596ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3925
5092024-06-06T21:17:48.603ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3981
5102024-06-06T21:17:48.764ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4043
5112024-06-06T21:17:48.879ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4024 rack_subnet = fd00:1122:3344::
5122024-06-06T21:17:48.905ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4071
5132024-06-06T21:17:49.010ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4098
5142024-06-06T21:17:49.132ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:365
5152024-06-06T21:17:49.164ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:413
5162024-06-06T21:17:49.196ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:651
5172024-06-06T21:17:49.196ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:689
5182024-06-06T21:17:49.196ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:692 uptime = 3
5192024-06-06T21:17:49.197ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:435
5202024-06-06T21:17:49.252ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_internal_dns_0cadf319-9a32-4627-b62e-a89e29bc1464
5212024-06-06T21:17:49.252ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_internal_dns_9bbce103-5b33-47af-9b52-de2a38d49d0d
5222024-06-06T21:17:49.252ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_internal_dns_41233370-3d38-4c23-8d31-93a659252461
5232024-06-06T21:17:49.253ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5242024-06-06T21:17:49.253ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5252024-06-06T21:17:49.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8497778 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:65045 req_id = e98251ba-843a-41d1-aadd-dedb8d2013a4 response_code = 204 uri = /omicron-zones
5262024-06-06T21:17:49.255ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5272024-06-06T21:17:49.281ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5282024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5292024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5302024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5312024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5322024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5332024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5342024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5352024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5362024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5372024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5382024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5392024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5402024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5412024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5422024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5432024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5442024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5452024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5462024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5472024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5482024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5492024-06-06T21:17:49.281ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5502024-06-06T21:17:49.343ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 116.649102ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5512024-06-06T21:17:49.477ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5522024-06-06T21:17:49.528ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5532024-06-06T21:17:49.574ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:585
5542024-06-06T21:17:49.574ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5552024-06-06T21:17:49.606ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5562024-06-06T21:17:49.607ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5572024-06-06T21:17:49.607ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5582024-06-06T21:17:49.636ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 41233370-3d38-4c23-8d31-93a659252461, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0cadf319-9a32-4627-b62e-a89e29bc1464, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: d68caf50-75c3-422c-a9b6-b8177ce6e5c8, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 201d9b62-3e6d-48d9-9bf0-77c4dc05d6b7, kind: Service { id: d68caf50-75c3-422c-a9b6-b8177ce6e5c8 }, name: Name("ntp-d68caf50-75c3-422c-a9b6-b8177ce6e5c8"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 136])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
5592024-06-06T21:17:49.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51504
5602024-06-06T21:17:49.636ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41233370-3d38-4c23-8d31-93a659252461, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5612024-06-06T21:17:49.636ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 41233370-3d38-4c23-8d31-93a659252461, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5622024-06-06T21:17:49.656ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5632024-06-06T21:17:49.656ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: InternalDns }, responder: ... }
5642024-06-06T21:17:49.673ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0cadf319-9a32-4627-b62e-a89e29bc1464, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5652024-06-06T21:17:49.673ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0cadf319-9a32-4627-b62e-a89e29bc1464, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5662024-06-06T21:17:49.690ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5672024-06-06T21:17:49.690ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/omicron-zones.json file = common/src/ledger.rs:177
5682024-06-06T21:17:49.690ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/omicron-zones.json file = common/src/ledger.rs:177
5692024-06-06T21:17:49.690ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5702024-06-06T21:17:49.701ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5712024-06-06T21:17:49.733ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5722024-06-06T21:17:49.733ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5732024-06-06T21:17:49.733ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5742024-06-06T21:17:49.777ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 200, 136]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5752024-06-06T21:17:49.777ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = ntp
5762024-06-06T21:17:49.778ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
5772024-06-06T21:17:49.778ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
5782024-06-06T21:17:49.778ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
5792024-06-06T21:17:49.779ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5802024-06-06T21:17:49.801ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 file = illumos-utils/src/zone.rs:315
5812024-06-06T21:17:49.820ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8 file = illumos-utils/src/zone.rs:354
5822024-06-06T21:17:50.440ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5832024-06-06T21:17:50.440ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5842024-06-06T21:17:50.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8") failed: Property not found. retry in 44.738055ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5852024-06-06T21:17:50.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8") failed: Property not found. retry in 68.635965ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5862024-06-06T21:17:50.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8") failed: Property not found. retry in 282.872993ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5872024-06-06T21:17:51.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8") failed: Property not found. retry in 470.62887ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5882024-06-06T21:17:51.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8") failed: Property not found. retry in 438.276477ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5892024-06-06T21:17:51.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8") failed: Property not found. retry in 843.513222ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5902024-06-06T21:17:52.526ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35593
5912024-06-06T21:17:52.526ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 94 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35593 req_id = 590bb590-8ae4-4fc0-8cbd-bc43f5764b25 response_code = 200 uri = /baseboard
5922024-06-06T21:17:52.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8") failed: Property not found. retry in 628.108044ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5932024-06-06T21:17:53.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8") failed: Property not found. retry in 1.266349717s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5942024-06-06T21:17:54.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8") failed: Property not found. retry in 1.165172078s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5952024-06-06T21:17:55.885ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8
5962024-06-06T21:17:55.885ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5972024-06-06T21:17:55.885ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5982024-06-06T21:17:55.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6249691 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51504 req_id = 6bba50e3-deeb-4807-9399-82dfcf17f02d response_code = 204 uri = /omicron-zones
5992024-06-06T21:17:55.888ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:626
6002024-06-06T21:17:55.917ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6012024-06-06T21:17:55.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46278
6022024-06-06T21:17:55.926ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3631
6032024-06-06T21:17:55.926ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 8942 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46278 req_id = d5915a4b-dca6-412c-879b-b8689ba317d8 response_code = 500 uri = /timesync
6042024-06-06T21:17:55.930ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6052024-06-06T21:17:56.049ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6062024-06-06T21:17:56.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44736
6072024-06-06T21:18:00.059ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3631
6082024-06-06T21:18:00.059ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4009403 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44736 req_id = 211b2115-96e6-4b46-9b72-b030e78cdc9d response_code = 500 uri = /timesync
6092024-06-06T21:18:00.063ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6102024-06-06T21:18:00.161ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6112024-06-06T21:18:00.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45958
6122024-06-06T21:18:00.170ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3631
6132024-06-06T21:18:00.170ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 9321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45958 req_id = 2a9008ff-7b67-4598-8553-f7dfe67dc3a8 response_code = 500 uri = /timesync
6142024-06-06T21:18:00.173ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6152024-06-06T21:18:00.375ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6162024-06-06T21:18:00.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50484
6172024-06-06T21:18:00.383ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_d68caf50-75c3-422c-a9b6-b8177ce6e5c8': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3631
6182024-06-06T21:18:00.383ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 8111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50484 req_id = 4fc6056b-beb1-442a-b585-9bea5ff3e763 response_code = 500 uri = /timesync
6192024-06-06T21:18:00.384ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6202024-06-06T21:18:00.672ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6212024-06-06T21:18:00.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51502
6222024-06-06T21:18:01.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1009063 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51502 req_id = 73ef8225-2998-4066-8ae9-67d2d40052b5 response_code = 200 uri = /timesync
6232024-06-06T21:18:01.683ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6242024-06-06T21:18:01.683ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6252024-06-06T21:18:01.894ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6262024-06-06T21:18:01.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54704
6272024-06-06T21:18:01.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54704 req_id = dbae5c83-cc32-41f5-bae5-fc1fb10d73cb response_code = 200 uri = /timesync
6282024-06-06T21:18:01.904ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6292024-06-06T21:18:01.904ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6302024-06-06T21:18:02.078ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6312024-06-06T21:18:02.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46217
6322024-06-06T21:18:02.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7736 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46217 req_id = a53cf1fe-6247-4f38-812e-87505a03a4a7 response_code = 200 uri = /timesync
6332024-06-06T21:18:02.089ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6342024-06-06T21:18:02.089ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6352024-06-06T21:18:02.424ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6362024-06-06T21:18:02.424ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50387
6372024-06-06T21:18:02.431ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50387 req_id = 3efdbd93-20c9-4977-a88f-e1256d65a483 response_code = 200 uri = /timesync
6382024-06-06T21:18:02.433ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6392024-06-06T21:18:02.433ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6402024-06-06T21:18:02.961ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6412024-06-06T21:18:02.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63797
6422024-06-06T21:18:02.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63797 req_id = 668b0e90-1e6a-4e55-bb78-c754d4fceaf5 response_code = 200 uri = /timesync
6432024-06-06T21:18:02.972ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6442024-06-06T21:18:02.972ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6452024-06-06T21:18:03.567ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6462024-06-06T21:18:03.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36218
6472024-06-06T21:18:03.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36218 req_id = 8e909b7e-759c-4db7-ae5c-0fe82711716d response_code = 200 uri = /timesync
6482024-06-06T21:18:03.578ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6492024-06-06T21:18:03.578ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6502024-06-06T21:18:03.938ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6512024-06-06T21:18:03.938ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47205
6522024-06-06T21:18:03.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7806 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47205 req_id = 9077b6d2-45fc-495f-92ea-7b4588e45bcf response_code = 200 uri = /timesync
6532024-06-06T21:18:03.949ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6542024-06-06T21:18:03.949ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6552024-06-06T21:18:04.499ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6562024-06-06T21:18:04.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46795
6572024-06-06T21:18:04.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7432 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46795 req_id = b82583fe-d652-4c67-b9ca-727cfa426dd6 response_code = 200 uri = /timesync
6582024-06-06T21:18:04.508ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6592024-06-06T21:18:04.508ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6602024-06-06T21:18:05.511ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6612024-06-06T21:18:05.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32896
6622024-06-06T21:18:05.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7874 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32896 req_id = 9e6c52e5-5825-4a99-a2f9-33ce7a8c2e99 response_code = 200 uri = /timesync
6632024-06-06T21:18:05.520ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6642024-06-06T21:18:05.520ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6652024-06-06T21:18:06.872ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6662024-06-06T21:18:06.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56832
6672024-06-06T21:18:06.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56832 req_id = 56d24725-ac42-4615-96fb-5a9093987810 response_code = 200 uri = /timesync
6682024-06-06T21:18:06.882ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.08449547 } file = sled-agent/src/rack_setup/service.rs:634
6692024-06-06T21:18:06.882ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6702024-06-06T21:18:08.029ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 230.073373ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
6712024-06-06T21:18:08.151ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6722024-06-06T21:18:08.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57813
6732024-06-06T21:18:08.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8580 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57813 req_id = 9dca73ce-fda6-4629-a268-2d707ced1a38 response_code = 200 uri = /timesync
6742024-06-06T21:18:08.162ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.081040457 } file = sled-agent/src/rack_setup/service.rs:634
6752024-06-06T21:18:08.162ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6762024-06-06T21:18:09.503ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6772024-06-06T21:18:09.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35563
6782024-06-06T21:18:09.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35563 req_id = f274286a-9aa6-4df4-b0e6-289e77f9e51a response_code = 200 uri = /timesync
6792024-06-06T21:18:09.514ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.078398265 } file = sled-agent/src/rack_setup/service.rs:634
6802024-06-06T21:18:09.514ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6812024-06-06T21:18:11.565ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6822024-06-06T21:18:11.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45406
6832024-06-06T21:18:11.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8615 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45406 req_id = 9b7d4b5e-d8b7-4eb4-b566-4605f99fe531 response_code = 200 uri = /timesync
6842024-06-06T21:18:11.576ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.072828375 } file = sled-agent/src/rack_setup/service.rs:634
6852024-06-06T21:18:11.576ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6862024-06-06T21:18:13.281ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6872024-06-06T21:18:13.281ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47517
6882024-06-06T21:18:13.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 10007 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47517 req_id = d6b1f117-1bac-40cf-8755-4b103217e581 response_code = 200 uri = /timesync
6892024-06-06T21:18:13.293ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.068193689 } file = sled-agent/src/rack_setup/service.rs:634
6902024-06-06T21:18:13.293ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6912024-06-06T21:18:15.696ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6922024-06-06T21:18:15.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34448
6932024-06-06T21:18:15.706ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34448 req_id = 35d6fafc-776e-4035-8dca-4f59e75c8d94 response_code = 200 uri = /timesync
6942024-06-06T21:18:15.708ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.06166961 } file = sled-agent/src/rack_setup/service.rs:634
6952024-06-06T21:18:15.708ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6962024-06-06T21:18:17.566ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6972024-06-06T21:18:17.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33037
6982024-06-06T21:18:17.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8289 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33037 req_id = 1148912d-9591-45e7-b29b-7e9967dde595 response_code = 200 uri = /timesync
6992024-06-06T21:18:17.577ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.056621853 } file = sled-agent/src/rack_setup/service.rs:634
7002024-06-06T21:18:17.577ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7012024-06-06T21:18:21.641ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7022024-06-06T21:18:21.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42006
7032024-06-06T21:18:21.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8760 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42006 req_id = e33f2c04-1a36-4718-ac70-32a194f17aa6 response_code = 200 uri = /timesync
7042024-06-06T21:18:21.652ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.045613475 } file = sled-agent/src/rack_setup/service.rs:634
7052024-06-06T21:18:21.652ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7062024-06-06T21:18:22.601ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56478
7072024-06-06T21:18:22.601ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56478 req_id = 60ad74c0-abd4-46e5-84dd-2c1e250280c7 response_code = 200 uri = /baseboard
7082024-06-06T21:18:23.335ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 559.964628ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
7092024-06-06T21:18:27.198ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7102024-06-06T21:18:27.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63534
7112024-06-06T21:18:27.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8988 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63534 req_id = 17b62daf-5bbe-416f-a939-e9353dffb476 response_code = 200 uri = /timesync
7122024-06-06T21:18:27.209ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.030605393 } file = sled-agent/src/rack_setup/service.rs:634
7132024-06-06T21:18:27.209ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7142024-06-06T21:18:30.466ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7152024-06-06T21:18:30.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61911
7162024-06-06T21:18:30.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8660 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61911 req_id = 1efeb7d0-38ca-4031-be47-0be988c39134 response_code = 200 uri = /timesync
7172024-06-06T21:18:30.477ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.021778567 } file = sled-agent/src/rack_setup/service.rs:634
7182024-06-06T21:18:30.477ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7192024-06-06T21:18:36.980ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7202024-06-06T21:18:36.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42867
7212024-06-06T21:18:36.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42867 req_id = 1f414d2d-0c26-4477-81be-d57ff7a789ce response_code = 200 uri = /timesync
7222024-06-06T21:18:36.991ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.004183868 } file = sled-agent/src/rack_setup/service.rs:634
7232024-06-06T21:18:36.991ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7242024-06-06T21:18:38.973ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 986.635527ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
7252024-06-06T21:18:44.601ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7262024-06-06T21:18:44.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48380
7272024-06-06T21:18:44.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9016 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48380 req_id = 40ce6508-6fbe-4537-8376-d8a4de70cdde response_code = 200 uri = /timesync
7282024-06-06T21:18:44.613ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.122e-5 } file = sled-agent/src/rack_setup/service.rs:634
7292024-06-06T21:18:44.613ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7302024-06-06T21:18:52.134ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7312024-06-06T21:18:52.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64449
7322024-06-06T21:18:52.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8568 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64449 req_id = 8a47cb5a-7373-4156-952e-77b78b4675f7 response_code = 200 uri = /timesync
7332024-06-06T21:18:52.146ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.102e-5 } file = sled-agent/src/rack_setup/service.rs:634
7342024-06-06T21:18:52.146ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7352024-06-06T21:18:52.679ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45387
7362024-06-06T21:18:52.680ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45387 req_id = 6a7e4dad-8a43-4117-9ae4-be522bef9b41 response_code = 200 uri = /baseboard
7372024-06-06T21:18:54.995ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.759347415s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
7382024-06-06T21:18:57.759ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7392024-06-06T21:18:57.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56970
7402024-06-06T21:18:57.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8965 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56970 req_id = 22940b0b-3f85-4247-82db-cb109fb4a6bb response_code = 200 uri = /timesync
7412024-06-06T21:18:57.771ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.087e-5 } file = sled-agent/src/rack_setup/service.rs:634
7422024-06-06T21:18:57.771ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7432024-06-06T21:19:06.978ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7442024-06-06T21:19:06.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41842
7452024-06-06T21:19:06.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8721 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41842 req_id = 0be6dcdf-01e3-46c6-a4a4-7e3df928c73d response_code = 200 uri = /timesync
7462024-06-06T21:19:06.989ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -1.0625e-5 } file = sled-agent/src/rack_setup/service.rs:634
7472024-06-06T21:19:06.989ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7482024-06-06T21:19:11.791ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.668633528s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
7492024-06-06T21:19:22.711ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35758
7502024-06-06T21:19:22.711ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35758 req_id = d9acbbc4-7228-4759-9d93-46d86a8ab40f response_code = 200 uri = /baseboard
7512024-06-06T21:19:24.339ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7522024-06-06T21:19:24.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51521
7532024-06-06T21:19:24.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 20067 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51521 req_id = 22f54bf7-4dcb-4228-9540-45d0f79427e8 response_code = 200 uri = /timesync
7542024-06-06T21:19:24.362ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2616771612, ip_addr: 155.248.196.28, stratum: 3, ref_time: 1717708752.5894015, correction: 0.000145449 } file = sled-agent/src/rack_setup/service.rs:634
7552024-06-06T21:19:24.362ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1217
7562024-06-06T21:19:24.391ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 41233370-3d38-4c23-8d31-93a659252461, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0cadf319-9a32-4627-b62e-a89e29bc1464, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: d68caf50-75c3-422c-a9b6-b8177ce6e5c8, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 201d9b62-3e6d-48d9-9bf0-77c4dc05d6b7, kind: Service { id: d68caf50-75c3-422c-a9b6-b8177ce6e5c8 }, name: Name("ntp-d68caf50-75c3-422c-a9b6-b8177ce6e5c8"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 136])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 0f875ebf-b78b-4e0d-9b1a-0dd427d82948, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } } } }, OmicronZoneConfig { id: 14a0db26-7082-4436-874e-aaf8a23652a4, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External } } } }, OmicronZoneConfig { id: bec22954-0f70-4c19-9bcb-c5066c06adcb, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d143acb-f7bf-42bf-8ede-864c65efb538, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: c26fe59f-46a4-4134-a99d-3dbf13bc15d2, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
7572024-06-06T21:19:24.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60235
7582024-06-06T21:19:24.392ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41233370-3d38-4c23-8d31-93a659252461, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7592024-06-06T21:19:24.392ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 41233370-3d38-4c23-8d31-93a659252461, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7602024-06-06T21:19:24.412ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7612024-06-06T21:19:24.412ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: InternalDns }, responder: ... }
7622024-06-06T21:19:24.432ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0cadf319-9a32-4627-b62e-a89e29bc1464, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7632024-06-06T21:19:24.432ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0cadf319-9a32-4627-b62e-a89e29bc1464, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7642024-06-06T21:19:24.449ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f875ebf-b78b-4e0d-9b1a-0dd427d82948, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7652024-06-06T21:19:24.449ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0f875ebf-b78b-4e0d-9b1a-0dd427d82948, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7662024-06-06T21:19:24.502ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 14a0db26-7082-4436-874e-aaf8a23652a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7672024-06-06T21:19:24.502ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 14a0db26-7082-4436-874e-aaf8a23652a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7682024-06-06T21:19:24.555ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bec22954-0f70-4c19-9bcb-c5066c06adcb, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7692024-06-06T21:19:24.555ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: bec22954-0f70-4c19-9bcb-c5066c06adcb, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7702024-06-06T21:19:24.608ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d143acb-f7bf-42bf-8ede-864c65efb538, dataset_name: DatasetName { pool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7712024-06-06T21:19:24.608ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7d143acb-f7bf-42bf-8ede-864c65efb538, dataset_name: DatasetName { pool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7722024-06-06T21:19:24.664ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c26fe59f-46a4-4134-a99d-3dbf13bc15d2, dataset_name: DatasetName { pool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7732024-06-06T21:19:24.664ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c26fe59f-46a4-4134-a99d-3dbf13bc15d2, dataset_name: DatasetName { pool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7742024-06-06T21:19:24.716ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7752024-06-06T21:19:24.717ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/omicron-zones.json file = common/src/ledger.rs:177
7762024-06-06T21:19:24.717ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/omicron-zones.json file = common/src/ledger.rs:177
7772024-06-06T21:19:24.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7782024-06-06T21:19:24.796ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7792024-06-06T21:19:24.796ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7802024-06-06T21:19:24.796ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7812024-06-06T21:19:24.796ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7822024-06-06T21:19:24.796ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7832024-06-06T21:19:24.887ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538 file = illumos-utils/src/zone.rs:315
7842024-06-06T21:19:24.891ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2 file = illumos-utils/src/zone.rs:315
7852024-06-06T21:19:24.895ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4 file = illumos-utils/src/zone.rs:315
7862024-06-06T21:19:24.899ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948 file = illumos-utils/src/zone.rs:315
7872024-06-06T21:19:24.904ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb file = illumos-utils/src/zone.rs:315
7882024-06-06T21:19:24.909ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538 file = illumos-utils/src/zone.rs:354
7892024-06-06T21:19:24.913ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2 file = illumos-utils/src/zone.rs:354
7902024-06-06T21:19:24.918ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4 file = illumos-utils/src/zone.rs:354
7912024-06-06T21:19:24.922ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948 file = illumos-utils/src/zone.rs:354
7922024-06-06T21:19:24.927ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb file = illumos-utils/src/zone.rs:354
7932024-06-06T21:19:27.784ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::6]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7942024-06-06T21:19:27.785ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
7952024-06-06T21:19:27.810ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::3]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7962024-06-06T21:19:27.810ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
7972024-06-06T21:19:27.862ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::5]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7982024-06-06T21:19:27.862ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
7992024-06-06T21:19:27.867ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::7]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8002024-06-06T21:19:27.867ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8012024-06-06T21:19:27.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 66.419108ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8022024-06-06T21:19:27.939ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::4]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8032024-06-06T21:19:27.939ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8042024-06-06T21:19:27.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 37.609368ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8052024-06-06T21:19:27.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 64.83091ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8062024-06-06T21:19:28.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 109.641725ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8072024-06-06T21:19:28.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 90.412358ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8082024-06-06T21:19:28.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 54.733047ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8092024-06-06T21:19:28.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 255.414945ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8102024-06-06T21:19:28.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 55.552064ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8112024-06-06T21:19:28.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 232.469188ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8122024-06-06T21:19:28.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 133.189103ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8132024-06-06T21:19:28.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 67.862969ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8142024-06-06T21:19:28.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 225.240495ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8152024-06-06T21:19:28.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 285.570434ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8162024-06-06T21:19:28.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 293.883323ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8172024-06-06T21:19:28.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 120.214598ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8182024-06-06T21:19:28.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 544.700504ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8192024-06-06T21:19:28.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 280.616893ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8202024-06-06T21:19:29.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 249.215301ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8212024-06-06T21:19:29.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 495.315169ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8222024-06-06T21:19:29.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 303.730018ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8232024-06-06T21:19:29.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 979.548607ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8242024-06-06T21:19:29.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 312.925907ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8252024-06-06T21:19:29.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 961.887432ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8262024-06-06T21:19:29.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 1.091089787s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8272024-06-06T21:19:29.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.17740287s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8282024-06-06T21:19:29.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 1.176845806s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8292024-06-06T21:19:30.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.273047037s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8302024-06-06T21:19:30.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 834.660111ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8312024-06-06T21:19:30.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 1.275918405s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8322024-06-06T21:19:30.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.405382375s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8332024-06-06T21:19:30.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 924.133952ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8342024-06-06T21:19:31.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 1.205339188s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8352024-06-06T21:19:31.497ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.358200666s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
8362024-06-06T21:19:31.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 610.855526ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8372024-06-06T21:19:31.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 561.720317ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8382024-06-06T21:19:31.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 1.469649535s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8392024-06-06T21:19:32.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 823.348031ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8402024-06-06T21:19:32.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.090059778s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8412024-06-06T21:19:32.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 1.156899621s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8422024-06-06T21:19:32.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 1.143127326s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8432024-06-06T21:19:33.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.36894631s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8442024-06-06T21:19:33.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.406735965s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8452024-06-06T21:19:33.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 960.893512ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8462024-06-06T21:19:33.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 1.175666506s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8472024-06-06T21:19:33.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 1.356603892s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8482024-06-06T21:19:34.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 1.274696421s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8492024-06-06T21:19:34.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.487215821s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8502024-06-06T21:19:34.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 679.979345ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8512024-06-06T21:19:34.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.253591999s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8522024-06-06T21:19:34.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538") failed: Property not found. retry in 1.304563974s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
8532024-06-06T21:19:35.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 559.887437ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8542024-06-06T21:19:35.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 820.822326ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8552024-06-06T21:19:35.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.395627752s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8562024-06-06T21:19:35.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 601.155656ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8572024-06-06T21:19:35.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 573.905359ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8582024-06-06T21:19:36.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 866.314137ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8592024-06-06T21:19:36.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 948.097999ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8602024-06-06T21:19:36.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.206609986s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8612024-06-06T21:19:37.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 1.148626911s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8622024-06-06T21:19:37.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 753.61083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8632024-06-06T21:19:37.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 710.785988ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8642024-06-06T21:19:37.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 983.518047ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8652024-06-06T21:19:38.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.434225021s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8662024-06-06T21:19:38.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 1.402371434s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8672024-06-06T21:19:38.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 682.401821ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8682024-06-06T21:19:38.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.073602144s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8692024-06-06T21:19:39.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 1.006216335s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8702024-06-06T21:19:39.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 786.259441ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8712024-06-06T21:19:39.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 936.215851ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8722024-06-06T21:19:39.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 708.482876ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8732024-06-06T21:19:40.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 1.29772783s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8742024-06-06T21:19:40.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.184856099s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8752024-06-06T21:19:40.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 795.360622ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8762024-06-06T21:19:40.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.149727611s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8772024-06-06T21:19:41.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 715.626857ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8782024-06-06T21:19:41.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 1.217670115s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8792024-06-06T21:19:41.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.39619477s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8802024-06-06T21:19:41.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 611.906958ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8812024-06-06T21:19:42.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 1.037778946s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8822024-06-06T21:19:42.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 793.427008ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8832024-06-06T21:19:42.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 841.622195ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8842024-06-06T21:19:42.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.041736237s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8852024-06-06T21:19:43.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 590.979105ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8862024-06-06T21:19:43.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.116664295s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8872024-06-06T21:19:43.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 655.017702ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8882024-06-06T21:19:43.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 703.58248ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8892024-06-06T21:19:43.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.16640277s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8902024-06-06T21:19:44.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 969.357381ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8912024-06-06T21:19:44.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 597.144499ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8922024-06-06T21:19:44.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 1.197763066s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8932024-06-06T21:19:44.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 883.59951ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8942024-06-06T21:19:45.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb") failed: Property not found. retry in 1.209273109s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
8952024-06-06T21:19:45.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 573.91686ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8962024-06-06T21:19:45.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4") failed: Property not found. retry in 1.474742825s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
8972024-06-06T21:19:45.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2") failed: Property not found. retry in 1.249826033s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
8982024-06-06T21:19:45.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948") failed: Property not found. retry in 1.263348806s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
8992024-06-06T21:19:47.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_cockroachdb_7d143acb-f7bf-42bf-8ede-864c65efb538
9002024-06-06T21:19:47.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_cockroachdb_c26fe59f-46a4-4134-a99d-3dbf13bc15d2
9012024-06-06T21:19:47.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_cockroachdb_14a0db26-7082-4436-874e-aaf8a23652a4
9022024-06-06T21:19:47.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_cockroachdb_0f875ebf-b78b-4e0d-9b1a-0dd427d82948
9032024-06-06T21:19:47.201ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_cockroachdb_bec22954-0f70-4c19-9bcb-c5066c06adcb
9042024-06-06T21:19:47.201ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9052024-06-06T21:19:47.202ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9062024-06-06T21:19:47.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 22810879 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60235 req_id = cf13d8f6-c662-4fea-afd6-ce17589ad73e response_code = 204 uri = /omicron-zones
9072024-06-06T21:19:47.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32768
9082024-06-06T21:19:47.268ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3465
9092024-06-06T21:19:52.776ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35686
9102024-06-06T21:19:52.777ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 916 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35686 req_id = ba56b8c0-223e-45e7-832f-5ff31082350a response_code = 200 uri = /baseboard
9112024-06-06T21:19:54.538ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3483
9122024-06-06T21:19:54.893ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 22.956026663s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
9132024-06-06T21:20:07.593ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3506
9142024-06-06T21:20:07.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 20357651 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32768 req_id = efdfcfc9-e55b-4f56-b8c2-46c4604f4a32 response_code = 204 uri = /cockroachdb
9152024-06-06T21:20:07.632ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 41233370-3d38-4c23-8d31-93a659252461, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 0cadf319-9a32-4627-b62e-a89e29bc1464, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: d68caf50-75c3-422c-a9b6-b8177ce6e5c8, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 201d9b62-3e6d-48d9-9bf0-77c4dc05d6b7, kind: Service { id: d68caf50-75c3-422c-a9b6-b8177ce6e5c8 }, name: Name("ntp-d68caf50-75c3-422c-a9b6-b8177ce6e5c8"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 200, 136])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 0f875ebf-b78b-4e0d-9b1a-0dd427d82948, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } } } }, OmicronZoneConfig { id: 14a0db26-7082-4436-874e-aaf8a23652a4, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External } } } }, OmicronZoneConfig { id: bec22954-0f70-4c19-9bcb-c5066c06adcb, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d143acb-f7bf-42bf-8ede-864c65efb538, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: c26fe59f-46a4-4134-a99d-3dbf13bc15d2, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 195b4132-10e8-4727-b637-c30c31ace91e, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 27b4c230-03de-4e03-9477-77afea2ad0c6, kind: Service { id: 195b4132-10e8-4727-b637-c30c31ace91e }, name: Name("external-dns-195b4132-10e8-4727-b637-c30c31ace91e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 28])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 80079700-d5d4-4db6-b900-053961147838, kind: Service { id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 }, name: Name("external-dns-c5446ba5-3edb-4e71-ba5e-0d0043e3bc83"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 8f450e43-fb82-424d-93ae-8706f0c64dd6, kind: Service { id: 9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e }, name: Name("nexus-9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: dffbd7ed-3079-42a4-94f9-56c58e2ba053, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: ed127a6b-6bcd-4179-86fc-e218f35f1bfc, kind: Service { id: dffbd7ed-3079-42a4-94f9-56c58e2ba053 }, name: Name("nexus-dffbd7ed-3079-42a4-94f9-56c58e2ba053"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a9b1f633-c495-4741-93cc-68f7b3dbc9b0, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 7b8f02c7-24b3-4bfb-8b43-71e7c3bc1912, kind: Service { id: a9b1f633-c495-4741-93cc-68f7b3dbc9b0 }, name: Name("nexus-a9b1f633-c495-4741-93cc-68f7b3dbc9b0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: cb62ae02-880a-44c5-97f2-f6f20968779b, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 78dcc329-b786-4ac2-98d7-e69f3b8429e4, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } } } }, OmicronZoneConfig { id: f8ec3793-6c94-4cbc-9b77-303d133636a8, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 694c58ca-a674-43bd-82f9-f9d312041dfb, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: ce357492-3eec-4158-aaf7-4741bdc1c741, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External } } } }, OmicronZoneConfig { id: 882765d7-a1fe-4ac6-913f-746a9fce9697, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External } } } }, OmicronZoneConfig { id: e74b2840-83c6-4e65-a3e2-eb76c6ca599c, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External } } } }, OmicronZoneConfig { id: 20270a34-9d4a-4540-9a1f-65aca8e7915f, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 82554264-4b10-48cd-a9aa-ce0814c24bf9, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External } } } }, OmicronZoneConfig { id: a4be2e7a-a8cc-4886-8fdd-f22edf8898fc, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0d4507b2-f585-45d8-bb5b-916ef11d551a (zpool), kind: External } } } }, OmicronZoneConfig { id: 3c79ae96-50ff-4e8f-9561-cc52684785e3, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798 (zpool), kind: External } } } }, OmicronZoneConfig { id: e631441c-51d7-4658-bba3-9e904aea4a13, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f940f667-095d-47e9-b4e9-c42a00bc2822 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 02a90705-a0f8-48c6-a1ce-d34d36f64f29 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
9162024-06-06T21:20:07.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36312
9172024-06-06T21:20:07.634ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 41233370-3d38-4c23-8d31-93a659252461, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9182024-06-06T21:20:07.634ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 41233370-3d38-4c23-8d31-93a659252461, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9192024-06-06T21:20:07.658ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9202024-06-06T21:20:07.658ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9bbce103-5b33-47af-9b52-de2a38d49d0d, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: InternalDns }, responder: ... }
9212024-06-06T21:20:07.678ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0cadf319-9a32-4627-b62e-a89e29bc1464, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9222024-06-06T21:20:07.678ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0cadf319-9a32-4627-b62e-a89e29bc1464, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9232024-06-06T21:20:07.698ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0f875ebf-b78b-4e0d-9b1a-0dd427d82948, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9242024-06-06T21:20:07.698ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0f875ebf-b78b-4e0d-9b1a-0dd427d82948, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9252024-06-06T21:20:07.716ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 14a0db26-7082-4436-874e-aaf8a23652a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9262024-06-06T21:20:07.716ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 14a0db26-7082-4436-874e-aaf8a23652a4, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9272024-06-06T21:20:07.736ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bec22954-0f70-4c19-9bcb-c5066c06adcb, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9282024-06-06T21:20:07.736ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: bec22954-0f70-4c19-9bcb-c5066c06adcb, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9292024-06-06T21:20:07.756ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d143acb-f7bf-42bf-8ede-864c65efb538, dataset_name: DatasetName { pool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9302024-06-06T21:20:07.756ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7d143acb-f7bf-42bf-8ede-864c65efb538, dataset_name: DatasetName { pool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9312024-06-06T21:20:07.774ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c26fe59f-46a4-4134-a99d-3dbf13bc15d2, dataset_name: DatasetName { pool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9322024-06-06T21:20:07.774ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c26fe59f-46a4-4134-a99d-3dbf13bc15d2, dataset_name: DatasetName { pool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9332024-06-06T21:20:07.794ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 195b4132-10e8-4727-b637-c30c31ace91e, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9342024-06-06T21:20:07.794ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 195b4132-10e8-4727-b637-c30c31ace91e, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9352024-06-06T21:20:07.924ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9362024-06-06T21:20:07.924ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9372024-06-06T21:20:08.038ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 78dcc329-b786-4ac2-98d7-e69f3b8429e4, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
9382024-06-06T21:20:08.038ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 78dcc329-b786-4ac2-98d7-e69f3b8429e4, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9392024-06-06T21:20:08.151ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ce357492-3eec-4158-aaf7-4741bdc1c741, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9402024-06-06T21:20:08.151ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ce357492-3eec-4158-aaf7-4741bdc1c741, dataset_name: DatasetName { pool_name: ZpoolName { id: c41774fe-e97b-4da8-a02e-62aed7a76752 (zpool), kind: External }, kind: Crucible }, responder: ... }
9412024-06-06T21:20:08.262ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 882765d7-a1fe-4ac6-913f-746a9fce9697, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9422024-06-06T21:20:08.262ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 882765d7-a1fe-4ac6-913f-746a9fce9697, dataset_name: DatasetName { pool_name: ZpoolName { id: 47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a (zpool), kind: External }, kind: Crucible }, responder: ... }
9432024-06-06T21:20:08.389ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e74b2840-83c6-4e65-a3e2-eb76c6ca599c, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9442024-06-06T21:20:08.389ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e74b2840-83c6-4e65-a3e2-eb76c6ca599c, dataset_name: DatasetName { pool_name: ZpoolName { id: f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25 (zpool), kind: External }, kind: Crucible }, responder: ... }
9452024-06-06T21:20:08.527ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 20270a34-9d4a-4540-9a1f-65aca8e7915f, dataset_name: DatasetName { pool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9462024-06-06T21:20:08.527ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 20270a34-9d4a-4540-9a1f-65aca8e7915f, dataset_name: DatasetName { pool_name: ZpoolName { id: be2ad19f-eecd-4c88-9423-9dddb68b99b1 (zpool), kind: External }, kind: Crucible }, responder: ... }
9472024-06-06T21:20:08.655ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 82554264-4b10-48cd-a9aa-ce0814c24bf9, dataset_name: DatasetName { pool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9482024-06-06T21:20:08.655ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 82554264-4b10-48cd-a9aa-ce0814c24bf9, dataset_name: DatasetName { pool_name: ZpoolName { id: 961e4b4e-d0f9-407e-bfb2-d5acdae78dc1 (zpool), kind: External }, kind: Crucible }, responder: ... }
9492024-06-06T21:20:08.783ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a4be2e7a-a8cc-4886-8fdd-f22edf8898fc, dataset_name: DatasetName { pool_name: ZpoolName { id: 0d4507b2-f585-45d8-bb5b-916ef11d551a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9502024-06-06T21:20:08.783ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a4be2e7a-a8cc-4886-8fdd-f22edf8898fc, dataset_name: DatasetName { pool_name: ZpoolName { id: 0d4507b2-f585-45d8-bb5b-916ef11d551a (zpool), kind: External }, kind: Crucible }, responder: ... }
9512024-06-06T21:20:08.918ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c79ae96-50ff-4e8f-9561-cc52684785e3, dataset_name: DatasetName { pool_name: ZpoolName { id: ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9522024-06-06T21:20:08.918ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3c79ae96-50ff-4e8f-9561-cc52684785e3, dataset_name: DatasetName { pool_name: ZpoolName { id: ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798 (zpool), kind: External }, kind: Crucible }, responder: ... }
9532024-06-06T21:20:09.044ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e631441c-51d7-4658-bba3-9e904aea4a13, dataset_name: DatasetName { pool_name: ZpoolName { id: f940f667-095d-47e9-b4e9-c42a00bc2822 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9542024-06-06T21:20:09.044ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e631441c-51d7-4658-bba3-9e904aea4a13, dataset_name: DatasetName { pool_name: ZpoolName { id: f940f667-095d-47e9-b4e9-c42a00bc2822 (zpool), kind: External }, kind: Crucible }, responder: ... }
9552024-06-06T21:20:09.173ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 02a90705-a0f8-48c6-a1ce-d34d36f64f29 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9562024-06-06T21:20:09.173ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a, dataset_name: DatasetName { pool_name: ZpoolName { id: 02a90705-a0f8-48c6-a1ce-d34d36f64f29 (zpool), kind: External }, kind: Crucible }, responder: ... }
9572024-06-06T21:20:09.296ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9582024-06-06T21:20:09.297ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/omicron-zones.json file = common/src/ledger.rs:177
9592024-06-06T21:20:09.297ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/omicron-zones.json file = common/src/ledger.rs:177
9602024-06-06T21:20:09.297ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9612024-06-06T21:20:09.439ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9622024-06-06T21:20:09.439ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9632024-06-06T21:20:09.439ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9642024-06-06T21:20:09.440ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9652024-06-06T21:20:09.444ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9662024-06-06T21:20:09.445ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9672024-06-06T21:20:09.445ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9682024-06-06T21:20:09.493ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9692024-06-06T21:20:09.493ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9702024-06-06T21:20:09.493ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9712024-06-06T21:20:09.493ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9722024-06-06T21:20:09.683ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9732024-06-06T21:20:09.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9742024-06-06T21:20:09.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9752024-06-06T21:20:09.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9762024-06-06T21:20:09.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9772024-06-06T21:20:09.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9782024-06-06T21:20:09.705ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9792024-06-06T21:20:09.705ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9802024-06-06T21:20:09.706ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741 file = illumos-utils/src/zone.rs:315
9812024-06-06T21:20:09.711ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8 file = illumos-utils/src/zone.rs:315
9822024-06-06T21:20:09.717ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6 file = illumos-utils/src/zone.rs:315
9832024-06-06T21:20:09.722ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb file = illumos-utils/src/zone.rs:315
9842024-06-06T21:20:09.728ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c file = illumos-utils/src/zone.rs:315
9852024-06-06T21:20:09.733ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f file = illumos-utils/src/zone.rs:315
9862024-06-06T21:20:09.738ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9 file = illumos-utils/src/zone.rs:315
9872024-06-06T21:20:09.885ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741 file = illumos-utils/src/zone.rs:354
9882024-06-06T21:20:09.889ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8 file = illumos-utils/src/zone.rs:354
9892024-06-06T21:20:09.894ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6 file = illumos-utils/src/zone.rs:354
9902024-06-06T21:20:09.899ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb file = illumos-utils/src/zone.rs:354
9912024-06-06T21:20:09.904ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c file = illumos-utils/src/zone.rs:354
9922024-06-06T21:20:09.909ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f file = illumos-utils/src/zone.rs:354
9932024-06-06T21:20:09.913ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9 file = illumos-utils/src/zone.rs:354
9942024-06-06T21:20:09.919ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697 file = illumos-utils/src/zone.rs:315
9952024-06-06T21:20:09.925ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3 file = illumos-utils/src/zone.rs:315
9962024-06-06T21:20:09.930ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13 file = illumos-utils/src/zone.rs:315
9972024-06-06T21:20:09.935ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b file = illumos-utils/src/zone.rs:315
9982024-06-06T21:20:09.941ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a file = illumos-utils/src/zone.rs:315
9992024-06-06T21:20:09.948ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4 file = illumos-utils/src/zone.rs:315
10002024-06-06T21:20:09.954ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc file = illumos-utils/src/zone.rs:315
10012024-06-06T21:20:09.961ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697 file = illumos-utils/src/zone.rs:354
10022024-06-06T21:20:09.966ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3 file = illumos-utils/src/zone.rs:354
10032024-06-06T21:20:09.972ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13 file = illumos-utils/src/zone.rs:354
10042024-06-06T21:20:09.978ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b file = illumos-utils/src/zone.rs:354
10052024-06-06T21:20:09.983ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a file = illumos-utils/src/zone.rs:354
10062024-06-06T21:20:09.988ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4 file = illumos-utils/src/zone.rs:354
10072024-06-06T21:20:09.992ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc file = illumos-utils/src/zone.rs:354
10082024-06-06T21:20:10.040ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10092024-06-06T21:20:10.118ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10102024-06-06T21:20:10.193ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10112024-06-06T21:20:10.276ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10122024-06-06T21:20:10.336ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10132024-06-06T21:20:10.338ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10142024-06-06T21:20:10.338ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10152024-06-06T21:20:10.425ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 221, 28]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte1" } }
10162024-06-06T21:20:10.425ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10172024-06-06T21:20:10.428ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10182024-06-06T21:20:10.428ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10192024-06-06T21:20:10.513ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 137, 134]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte2" } }
10202024-06-06T21:20:10.513ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10212024-06-06T21:20:10.518ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10222024-06-06T21:20:10.518ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10232024-06-06T21:20:10.598ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 158, 103]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte3" } }
10242024-06-06T21:20:10.598ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10252024-06-06T21:20:10.602ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10262024-06-06T21:20:10.602ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10272024-06-06T21:20:10.687ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 156, 200]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte4" } }
10282024-06-06T21:20:10.687ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10292024-06-06T21:20:10.691ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10302024-06-06T21:20:10.691ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10312024-06-06T21:20:10.780ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 128, 58]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte5" } }
10322024-06-06T21:20:10.780ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10332024-06-06T21:20:10.783ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10342024-06-06T21:20:10.783ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10352024-06-06T21:20:10.783ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10362024-06-06T21:20:10.783ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10372024-06-06T21:20:10.783ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10382024-06-06T21:20:10.783ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10392024-06-06T21:20:10.783ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10402024-06-06T21:20:10.783ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10412024-06-06T21:20:10.784ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10422024-06-06T21:20:10.784ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10432024-06-06T21:20:10.788ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10442024-06-06T21:20:10.792ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10452024-06-06T21:20:10.833ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10462024-06-06T21:20:10.837ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10472024-06-06T21:20:10.837ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10482024-06-06T21:20:10.840ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10492024-06-06T21:20:10.840ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10502024-06-06T21:20:10.844ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10512024-06-06T21:20:10.848ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10522024-06-06T21:20:10.848ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10532024-06-06T21:20:11.010ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0 file = illumos-utils/src/zone.rs:315
10542024-06-06T21:20:11.022ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e file = illumos-utils/src/zone.rs:315
10552024-06-06T21:20:11.035ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 file = illumos-utils/src/zone.rs:315
10562024-06-06T21:20:11.045ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e file = illumos-utils/src/zone.rs:315
10572024-06-06T21:20:11.057ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053 file = illumos-utils/src/zone.rs:315
10582024-06-06T21:20:11.073ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0 file = illumos-utils/src/zone.rs:354
10592024-06-06T21:20:11.083ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e file = illumos-utils/src/zone.rs:354
10602024-06-06T21:20:11.094ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 file = illumos-utils/src/zone.rs:354
10612024-06-06T21:20:11.105ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e file = illumos-utils/src/zone.rs:354
10622024-06-06T21:20:11.115ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053 file = illumos-utils/src/zone.rs:354
10632024-06-06T21:20:15.522ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10642024-06-06T21:20:15.528ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10652024-06-06T21:20:15.531ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
10662024-06-06T21:20:15.575ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10672024-06-06T21:20:15.576ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
10682024-06-06T21:20:15.597ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
10692024-06-06T21:20:16.894ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="414079b6-ab62-48e3-8051-7d11ac147094"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10702024-06-06T21:20:16.894ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="dbc47b1d-67b4-4115-a482-9fb449864e10"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10712024-06-06T21:20:16.895ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_f940f667-095d-47e9-b4e9-c42a00bc2822/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="da9378be-57a1-4fc8-9330-e24e626fc207"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10722024-06-06T21:20:16.896ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_02a90705-a0f8-48c6-a1ce-d34d36f64f29/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="c55dd988-0922-4c3e-8397-340bcaa20340"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10732024-06-06T21:20:16.896ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
10742024-06-06T21:20:16.907ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="7cf1d4c1-ad66-46fa-8396-7f6cc7ef9c90"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10752024-06-06T21:20:16.907ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
10762024-06-06T21:20:16.915ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
10772024-06-06T21:20:16.923ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
10782024-06-06T21:20:16.931ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_0d4507b2-f585-45d8-bb5b-916ef11d551a/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="0ff9022a-62db-404f-8ba5-b3494c3d4b69"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10792024-06-06T21:20:16.932ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_c41774fe-e97b-4da8-a02e-62aed7a76752/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="1f1ade66-2f21-4489-aeb5-3d79161b6ee9"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10802024-06-06T21:20:16.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 54.666158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
10812024-06-06T21:20:16.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 25.236923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
10822024-06-06T21:20:16.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 65.399351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
10832024-06-06T21:20:16.977ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="33ab83bc-aa53-402a-9e92-514768d5b3d3"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10842024-06-06T21:20:16.977ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_be2ad19f-eecd-4c88-9423-9dddb68b99b1/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="af20426b-052c-4a8c-8072-204a8e3644c0"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10852024-06-06T21:20:16.977ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
10862024-06-06T21:20:16.987ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
10872024-06-06T21:20:16.995ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
10882024-06-06T21:20:17.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 102.45621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
10892024-06-06T21:20:17.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 124.088033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
10902024-06-06T21:20:17.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 68.959806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
10912024-06-06T21:20:17.155ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
10922024-06-06T21:20:17.178ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
10932024-06-06T21:20:17.256ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="cb62ae02-880a-44c5-97f2-f6f20968779b"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10942024-06-06T21:20:17.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 142.856048ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
10952024-06-06T21:20:18.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 197.542603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
10962024-06-06T21:20:18.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 272.536889ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
10972024-06-06T21:20:18.662ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
10982024-06-06T21:20:18.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 399.707518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
10992024-06-06T21:20:18.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 58.038354ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
11002024-06-06T21:20:18.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 46.181888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
11012024-06-06T21:20:18.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 27.985146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
11022024-06-06T21:20:18.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 33.601197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
11032024-06-06T21:20:18.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 529.937041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
11042024-06-06T21:20:18.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 78.187179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
11052024-06-06T21:20:18.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 40.376675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
11062024-06-06T21:20:18.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 85.922451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
11072024-06-06T21:20:18.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 130.292606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
11082024-06-06T21:20:18.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 128.138077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
11092024-06-06T21:20:19.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 32.789394ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
11102024-06-06T21:20:19.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 71.927506ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
11112024-06-06T21:20:19.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 1.031938937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
11122024-06-06T21:20:19.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 206.341912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
11132024-06-06T21:20:19.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 30.203711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
11142024-06-06T21:20:19.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 64.558413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
11152024-06-06T21:20:19.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 191.844611ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
11162024-06-06T21:20:19.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 68.490871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
11172024-06-06T21:20:19.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 254.153847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
11182024-06-06T21:20:19.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 104.05653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
11192024-06-06T21:20:19.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 73.517585ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
11202024-06-06T21:20:19.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 111.154678ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
11212024-06-06T21:20:19.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 112.036863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
11222024-06-06T21:20:19.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 55.772177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
11232024-06-06T21:20:19.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.12776645s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
11242024-06-06T21:20:19.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 628.983666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
11252024-06-06T21:20:19.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 74.135768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
11262024-06-06T21:20:19.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 109.292038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
11272024-06-06T21:20:19.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 267.422766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
11282024-06-06T21:20:19.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 284.771122ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
11292024-06-06T21:20:19.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 352.468386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
11302024-06-06T21:20:19.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 474.414676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
11312024-06-06T21:20:19.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 123.429353ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
11322024-06-06T21:20:19.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 537.323229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
11332024-06-06T21:20:20.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 171.025227ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
11342024-06-06T21:20:20.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 237.178637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
11352024-06-06T21:20:20.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 205.880825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
11362024-06-06T21:20:20.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 223.781192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
11372024-06-06T21:20:20.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 148.829883ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
11382024-06-06T21:20:20.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 268.42696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
11392024-06-06T21:20:20.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 959.207314ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
11402024-06-06T21:20:20.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 672.314493ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
11412024-06-06T21:20:20.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 334.866447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
11422024-06-06T21:20:20.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 490.190262ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
11432024-06-06T21:20:20.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 483.410722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
11442024-06-06T21:20:20.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 554.790311ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
11452024-06-06T21:20:20.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 263.692881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
11462024-06-06T21:20:20.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 732.499874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
11472024-06-06T21:20:20.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 816.478647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
11482024-06-06T21:20:20.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 820.506292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
11492024-06-06T21:20:20.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 422.739725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
11502024-06-06T21:20:20.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 521.01944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
11512024-06-06T21:20:20.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 849.866377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
11522024-06-06T21:20:20.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 917.452764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
11532024-06-06T21:20:20.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 760.848582ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
11542024-06-06T21:20:20.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 635.213214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
11552024-06-06T21:20:20.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.065452682s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
11562024-06-06T21:20:20.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.446966077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
11572024-06-06T21:20:20.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 1.327722402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
11582024-06-06T21:20:20.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 606.510498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
11592024-06-06T21:20:21.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 962.741641ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
11602024-06-06T21:20:21.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 1.444884609s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
11612024-06-06T21:20:21.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.473103828s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
11622024-06-06T21:20:21.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 815.456015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
11632024-06-06T21:20:21.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 803.265356ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
11642024-06-06T21:20:21.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 1.215456889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
11652024-06-06T21:20:21.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.350746326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
11662024-06-06T21:20:21.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.467679525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
11672024-06-06T21:20:21.574ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11682024-06-06T21:20:21.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 1.232833016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
11692024-06-06T21:20:21.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 969.993371ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
11702024-06-06T21:20:21.821ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11712024-06-06T21:20:21.822ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
11722024-06-06T21:20:21.959ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
11732024-06-06T21:20:21.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.351633801s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
11742024-06-06T21:20:21.980ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11752024-06-06T21:20:21.980ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11762024-06-06T21:20:21.980ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
11772024-06-06T21:20:21.987ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11782024-06-06T21:20:22.030ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
11792024-06-06T21:20:22.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 1.11432874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
11802024-06-06T21:20:22.048ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
11812024-06-06T21:20:22.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 901.947884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
11822024-06-06T21:20:22.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 801.889763ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
11832024-06-06T21:20:22.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 54.482645ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
11842024-06-06T21:20:22.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 62.194151ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
11852024-06-06T21:20:22.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 63.370391ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
11862024-06-06T21:20:22.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 46.776472ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
11872024-06-06T21:20:22.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 50.49746ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
11882024-06-06T21:20:22.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 697.781462ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
11892024-06-06T21:20:22.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 74.230446ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
11902024-06-06T21:20:22.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 69.397533ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
11912024-06-06T21:20:22.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 136.276783ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
11922024-06-06T21:20:22.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 85.988386ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
11932024-06-06T21:20:22.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 148.688597ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
11942024-06-06T21:20:22.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 120.35266ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
11952024-06-06T21:20:22.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 72.831333ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
11962024-06-06T21:20:22.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.461664574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
11972024-06-06T21:20:22.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 146.516245ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
11982024-06-06T21:20:22.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 114.635157ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
11992024-06-06T21:20:22.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 126.536957ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
12002024-06-06T21:20:22.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 379.311408ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
12012024-06-06T21:20:22.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 422.188102ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
12022024-06-06T21:20:22.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 353.288971ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
12032024-06-06T21:20:22.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 322.855511ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
12042024-06-06T21:20:22.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 929.623868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
12052024-06-06T21:20:22.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 414.541204ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
12062024-06-06T21:20:22.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.143292006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
12072024-06-06T21:20:22.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 1.123584342s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
12082024-06-06T21:20:22.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 794.17982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
12092024-06-06T21:20:22.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 1.161099457s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
12102024-06-06T21:20:22.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 575.85921ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
12112024-06-06T21:20:22.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 639.635276ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
12122024-06-06T21:20:22.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 836.9348ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
12132024-06-06T21:20:22.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.353747351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
12142024-06-06T21:20:22.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 1.429675514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
12152024-06-06T21:20:22.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 1.291507964s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
12162024-06-06T21:20:22.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 846.57912ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
12172024-06-06T21:20:23.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.080621331s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
12182024-06-06T21:20:23.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 1.135654844s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
12192024-06-06T21:20:23.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.016023668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
12202024-06-06T21:20:23.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 732.855443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
12212024-06-06T21:20:23.203ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32913
12222024-06-06T21:20:23.282ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 77174 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32913 req_id = 7e1b0b0b-2e72-4a6c-80a9-530e50ff2075 response_code = 200 uri = /baseboard
12232024-06-06T21:20:23.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.27415855s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
12242024-06-06T21:20:23.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 525.840902ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
12252024-06-06T21:20:23.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 692.359308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
12262024-06-06T21:20:23.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 748.118365ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
12272024-06-06T21:20:23.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 511.338673ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
12282024-06-06T21:20:23.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 976.883386ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
12292024-06-06T21:20:23.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 824.24771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
12302024-06-06T21:20:23.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 545.274571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
12312024-06-06T21:20:23.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 951.750638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
12322024-06-06T21:20:23.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 1.243892058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
12332024-06-06T21:20:23.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 517.221731ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
12342024-06-06T21:20:24.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 1.3667853s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
12352024-06-06T21:20:24.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 1.18216571s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
12362024-06-06T21:20:24.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.137859068s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
12372024-06-06T21:20:24.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.308773272s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
12382024-06-06T21:20:24.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 1.21259959s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
12392024-06-06T21:20:24.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 1.171227763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
12402024-06-06T21:20:24.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 1.417066018s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
12412024-06-06T21:20:24.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 772.159512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
12422024-06-06T21:20:24.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.047105818s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
12432024-06-06T21:20:24.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 676.355124ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
12442024-06-06T21:20:24.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 1.42569821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
12452024-06-06T21:20:24.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 874.696949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
12462024-06-06T21:20:24.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 540.808891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
12472024-06-06T21:20:24.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.000922661s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
12482024-06-06T21:20:24.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.470295854s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
12492024-06-06T21:20:24.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 1.182832153s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
12502024-06-06T21:20:24.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 515.352445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
12512024-06-06T21:20:25.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 805.666482ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
12522024-06-06T21:20:25.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 1.493274104s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
12532024-06-06T21:20:25.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 933.061315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
12542024-06-06T21:20:25.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 747.506545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
12552024-06-06T21:20:25.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 650.210733ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
12562024-06-06T21:20:25.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 526.643747ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
12572024-06-06T21:20:25.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.374621872s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
12582024-06-06T21:20:25.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 1.471871314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
12592024-06-06T21:20:25.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.092371314s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
12602024-06-06T21:20:25.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 1.24176391s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
12612024-06-06T21:20:25.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 760.279529ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
12622024-06-06T21:20:25.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 984.014206ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
12632024-06-06T21:20:25.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.348269724s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
12642024-06-06T21:20:25.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 623.202696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
12652024-06-06T21:20:25.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 538.826862ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
12662024-06-06T21:20:25.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 524.436899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
12672024-06-06T21:20:25.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 1.043672746s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
12682024-06-06T21:20:25.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 1.289233812s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
12692024-06-06T21:20:25.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 1.198505044s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
12702024-06-06T21:20:25.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 742.718364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
12712024-06-06T21:20:25.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 1.012224854s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
12722024-06-06T21:20:25.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 632.01302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
12732024-06-06T21:20:26.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.321780458s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
12742024-06-06T21:20:26.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 910.122982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
12752024-06-06T21:20:26.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.391563945s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
12762024-06-06T21:20:26.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.150018554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
12772024-06-06T21:20:26.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 869.145895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
12782024-06-06T21:20:26.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 1.29245961s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
12792024-06-06T21:20:26.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 681.822704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
12802024-06-06T21:20:26.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 1.132945457s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
12812024-06-06T21:20:26.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 790.925869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
12822024-06-06T21:20:26.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 1.168719141s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
12832024-06-06T21:20:26.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 580.163769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
12842024-06-06T21:20:26.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 789.918149ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
12852024-06-06T21:20:26.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.022485806s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
12862024-06-06T21:20:26.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 1.1867927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
12872024-06-06T21:20:26.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 681.668651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
12882024-06-06T21:20:26.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 1.238919059s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
12892024-06-06T21:20:27.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 633.712777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
12902024-06-06T21:20:27.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 767.973868ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
12912024-06-06T21:20:27.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 793.422719ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
12922024-06-06T21:20:27.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 548.308613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
12932024-06-06T21:20:27.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 1.142696225s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
12942024-06-06T21:20:27.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 1.463154926s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
12952024-06-06T21:20:27.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 937.46095ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
12962024-06-06T21:20:27.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.247459636s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
12972024-06-06T21:20:27.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.017890799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
12982024-06-06T21:20:27.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 1.393633835s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
12992024-06-06T21:20:27.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.391209822s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
13002024-06-06T21:20:27.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 896.268327ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
13012024-06-06T21:20:27.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 939.711941ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
13022024-06-06T21:20:27.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 854.349621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
13032024-06-06T21:20:27.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 1.102024383s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
13042024-06-06T21:20:27.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 752.034044ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
13052024-06-06T21:20:27.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 938.395834ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
13062024-06-06T21:20:28.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 1.404465943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
13072024-06-06T21:20:28.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 703.565125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
13082024-06-06T21:20:28.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.427223009s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
13092024-06-06T21:20:28.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 1.109391126s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
13102024-06-06T21:20:28.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 756.433053ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
13112024-06-06T21:20:28.285ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13122024-06-06T21:20:28.286ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
13132024-06-06T21:20:28.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 601.705448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
13142024-06-06T21:20:28.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 963.491665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
13152024-06-06T21:20:28.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.440438909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
13162024-06-06T21:20:28.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 67.877232ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
13172024-06-06T21:20:28.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 138.06393ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
13182024-06-06T21:20:28.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.482966192s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
13192024-06-06T21:20:28.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.171122484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
13202024-06-06T21:20:28.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 616.692296ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
13212024-06-06T21:20:28.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 171.375827ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
13222024-06-06T21:20:28.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.194508376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
13232024-06-06T21:20:28.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 1.494489935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
13242024-06-06T21:20:28.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 691.848023ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
13252024-06-06T21:20:28.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 1.036143384s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
13262024-06-06T21:20:28.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 994.199876ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
13272024-06-06T21:20:28.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 573.713163ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
13282024-06-06T21:20:28.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 1.245207647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
13292024-06-06T21:20:28.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 1.454012255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
13302024-06-06T21:20:28.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 976.13924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
13312024-06-06T21:20:29.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 1.39600927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
13322024-06-06T21:20:29.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 925.406187ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
13332024-06-06T21:20:29.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 1.189964367s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
13342024-06-06T21:20:29.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 1.25237932s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
13352024-06-06T21:20:29.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 1.182408415s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
13362024-06-06T21:20:29.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 878.393331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
13372024-06-06T21:20:29.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 531.383295ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
13382024-06-06T21:20:29.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 932.804406ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
13392024-06-06T21:20:29.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 532.388159ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
13402024-06-06T21:20:29.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 711.598776ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
13412024-06-06T21:20:29.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 1.283046452s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
13422024-06-06T21:20:29.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.486079801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
13432024-06-06T21:20:29.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 942.161741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
13442024-06-06T21:20:29.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.033849077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
13452024-06-06T21:20:29.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 587.047025ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
13462024-06-06T21:20:29.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.055475752s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
13472024-06-06T21:20:30.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 1.146371447s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
13482024-06-06T21:20:30.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.194659946s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
13492024-06-06T21:20:30.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.493216194s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
13502024-06-06T21:20:30.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 594.662378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
13512024-06-06T21:20:30.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 834.449091ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
13522024-06-06T21:20:30.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 1.450827009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
13532024-06-06T21:20:30.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 538.636282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
13542024-06-06T21:20:30.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 1.430403494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
13552024-06-06T21:20:30.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 1.204880644s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
13562024-06-06T21:20:30.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 1.394878545s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
13572024-06-06T21:20:30.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 929.596718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
13582024-06-06T21:20:30.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 1.326723217s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
13592024-06-06T21:20:30.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 541.90536ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
13602024-06-06T21:20:30.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 838.130551ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
13612024-06-06T21:20:30.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 1.494623536s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
13622024-06-06T21:20:30.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 814.713014ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
13632024-06-06T21:20:30.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 808.397601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
13642024-06-06T21:20:31.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 629.208233ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
13652024-06-06T21:20:31.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.034867991s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
13662024-06-06T21:20:31.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 962.931131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
13672024-06-06T21:20:31.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 742.01539ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
13682024-06-06T21:20:31.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 721.011426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
13692024-06-06T21:20:31.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 1.36112233s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
13702024-06-06T21:20:31.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.206341408s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
13712024-06-06T21:20:31.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 699.797891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
13722024-06-06T21:20:31.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 725.881652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
13732024-06-06T21:20:31.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 1.256899808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
13742024-06-06T21:20:31.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.353178585s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
13752024-06-06T21:20:31.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.257924718s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
13762024-06-06T21:20:31.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 1.169264804s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
13772024-06-06T21:20:31.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.206426379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
13782024-06-06T21:20:31.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 1.035619517s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
13792024-06-06T21:20:31.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 758.51414ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
13802024-06-06T21:20:31.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 813.680844ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
13812024-06-06T21:20:31.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 745.951094ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
13822024-06-06T21:20:31.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 1.285417457s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
13832024-06-06T21:20:31.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 991.407601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
13842024-06-06T21:20:31.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 1.235414106s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
13852024-06-06T21:20:32.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 681.770743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
13862024-06-06T21:20:32.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 637.297524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
13872024-06-06T21:20:32.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 970.469475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
13882024-06-06T21:20:32.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 1.408648708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
13892024-06-06T21:20:32.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 942.967472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
13902024-06-06T21:20:32.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 636.240939ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
13912024-06-06T21:20:32.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 1.00494217s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
13922024-06-06T21:20:32.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 1.457635482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
13932024-06-06T21:20:32.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 745.648947ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
13942024-06-06T21:20:32.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 984.027986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
13952024-06-06T21:20:32.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.060834431s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
13962024-06-06T21:20:32.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 741.864157ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
13972024-06-06T21:20:32.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.365283053s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
13982024-06-06T21:20:32.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 1.48923295s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
13992024-06-06T21:20:32.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 940.73863ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
14002024-06-06T21:20:32.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 1.311227908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
14012024-06-06T21:20:32.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 596.358104ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
14022024-06-06T21:20:32.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.229032461s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
14032024-06-06T21:20:33.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 757.788885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
14042024-06-06T21:20:33.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 561.79342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
14052024-06-06T21:20:33.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 585.029905ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
14062024-06-06T21:20:33.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.244409087s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
14072024-06-06T21:20:33.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 1.086883034s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
14082024-06-06T21:20:33.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 702.477752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
14092024-06-06T21:20:33.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 1.294267535s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
14102024-06-06T21:20:33.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 1.362285436s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
14112024-06-06T21:20:33.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.468164993s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
14122024-06-06T21:20:33.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 616.993388ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
14132024-06-06T21:20:33.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 1.303724722s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
14142024-06-06T21:20:33.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 923.760078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
14152024-06-06T21:20:33.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 1.044206189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
14162024-06-06T21:20:33.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 1.025509763s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
14172024-06-06T21:20:33.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.294764057s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
14182024-06-06T21:20:33.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 1.4528611s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
14192024-06-06T21:20:33.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 897.367334ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
14202024-06-06T21:20:34.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 1.165622052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
14212024-06-06T21:20:34.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 922.328617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
14222024-06-06T21:20:34.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 733.46313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
14232024-06-06T21:20:34.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 806.638548ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
14242024-06-06T21:20:34.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 638.578047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
14252024-06-06T21:20:34.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 1.261641786s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
14262024-06-06T21:20:34.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 1.334617669s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
14272024-06-06T21:20:34.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 1.413298439s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
14282024-06-06T21:20:34.426ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 40.567611375s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
14292024-06-06T21:20:34.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 822.636352ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
14302024-06-06T21:20:34.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 1.024399565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
14312024-06-06T21:20:34.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 543.532388ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
14322024-06-06T21:20:34.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.129710937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
14332024-06-06T21:20:34.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 683.090417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
14342024-06-06T21:20:34.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 873.311678ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
14352024-06-06T21:20:34.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 1.149609985s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
14362024-06-06T21:20:34.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 1.263513996s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
14372024-06-06T21:20:34.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 897.496634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
14382024-06-06T21:20:34.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 981.561398ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
14392024-06-06T21:20:35.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.006664317s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
14402024-06-06T21:20:35.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 924.020645ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
14412024-06-06T21:20:35.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 1.418280708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
14422024-06-06T21:20:35.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 718.591748ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
14432024-06-06T21:20:35.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 1.435186209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
14442024-06-06T21:20:35.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 680.669725ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
14452024-06-06T21:20:35.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 762.761293ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
14462024-06-06T21:20:35.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 793.021001ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
14472024-06-06T21:20:35.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 731.748426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
14482024-06-06T21:20:35.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 655.09494ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
14492024-06-06T21:20:35.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 1.016042455s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
14502024-06-06T21:20:35.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 649.551393ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
14512024-06-06T21:20:35.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 976.107504ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
14522024-06-06T21:20:35.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 725.469068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
14532024-06-06T21:20:35.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.304170808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
14542024-06-06T21:20:35.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.121889943s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
14552024-06-06T21:20:35.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.263600585s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
14562024-06-06T21:20:35.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 1.431050884s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
14572024-06-06T21:20:35.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.094146926s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
14582024-06-06T21:20:35.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 1.147947971s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
14592024-06-06T21:20:36.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.015121282s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
14602024-06-06T21:20:36.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 624.419747ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
14612024-06-06T21:20:36.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 1.143008313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
14622024-06-06T21:20:36.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 1.246113266s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
14632024-06-06T21:20:36.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 670.9339ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
14642024-06-06T21:20:36.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 1.125639043s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
14652024-06-06T21:20:36.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 704.549545ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
14662024-06-06T21:20:36.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 872.318767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
14672024-06-06T21:20:36.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 591.817778ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
14682024-06-06T21:20:36.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 727.30412ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
14692024-06-06T21:20:36.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 1.491772675s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
14702024-06-06T21:20:36.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 676.761582ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
14712024-06-06T21:20:36.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 1.307127358s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
14722024-06-06T21:20:36.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 1.476758487s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
14732024-06-06T21:20:36.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 503.491905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
14742024-06-06T21:20:36.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 1.381453977s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
14752024-06-06T21:20:36.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 1.042230437s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
14762024-06-06T21:20:37.073ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 590.349406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
14772024-06-06T21:20:37.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.018230866s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
14782024-06-06T21:20:37.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 680.339384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
14792024-06-06T21:20:37.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 789.037009ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
14802024-06-06T21:20:37.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 1.087433742s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
14812024-06-06T21:20:37.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 832.374283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
14822024-06-06T21:20:37.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 564.955424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
14832024-06-06T21:20:37.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 528.853326ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
14842024-06-06T21:20:37.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 1.215673952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
14852024-06-06T21:20:37.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 1.051022516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
14862024-06-06T21:20:37.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 862.881826ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
14872024-06-06T21:20:37.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 1.038673733s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
14882024-06-06T21:20:37.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 1.019385382s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
14892024-06-06T21:20:37.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 756.446567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
14902024-06-06T21:20:37.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.263715701s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
14912024-06-06T21:20:37.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 992.328881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
14922024-06-06T21:20:37.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 1.17344728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
14932024-06-06T21:20:37.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 1.123485837s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
14942024-06-06T21:20:37.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b") failed: Property not found. retry in 507.225113ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
14952024-06-06T21:20:38.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f") failed: Property not found. retry in 1.002865628s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
14962024-06-06T21:20:38.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 935.884741ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
14972024-06-06T21:20:38.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 523.957265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
14982024-06-06T21:20:38.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 933.766671ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
14992024-06-06T21:20:38.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 566.253026ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
15002024-06-06T21:20:38.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83") failed: Property not found. retry in 1.267699358s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
15012024-06-06T21:20:38.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 881.403706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
15022024-06-06T21:20:38.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4") failed: Property not found. retry in 1.433868444s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
15032024-06-06T21:20:38.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6") failed: Property not found. retry in 724.225023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
15042024-06-06T21:20:38.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 722.710811ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
15052024-06-06T21:20:38.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c") failed: Property not found. retry in 1.490437399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
15062024-06-06T21:20:38.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3") failed: Property not found. retry in 1.248444947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
15072024-06-06T21:20:38.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 562.794943ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
15082024-06-06T21:20:38.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13") failed: Property not found. retry in 1.165045735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
15092024-06-06T21:20:38.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 543.74106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
15102024-06-06T21:20:38.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741") failed: Property not found. retry in 607.012275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
15112024-06-06T21:20:38.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8") failed: Property not found. retry in 540.643132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
15122024-06-06T21:20:38.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc") failed: Property not found. retry in 911.55094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
15132024-06-06T21:20:38.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9") failed: Property not found. retry in 1.461853932s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
15142024-06-06T21:20:38.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0") failed: Property not found. retry in 1.212791719s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
15152024-06-06T21:20:38.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a") failed: Property not found. retry in 865.354718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
15162024-06-06T21:20:39.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e") failed: Property not found. retry in 1.226891334s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
15172024-06-06T21:20:39.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053") failed: Property not found. retry in 1.097467952s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
15182024-06-06T21:20:39.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e") failed: Property not found. retry in 629.337084ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
15192024-06-06T21:20:39.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb") failed: Property not found. retry in 689.670046ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
15202024-06-06T21:20:39.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697") failed: Property not found. retry in 994.603744ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
15212024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_ce357492-3eec-4158-aaf7-4741bdc1c741
15222024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_pantry_f8ec3793-6c94-4cbc-9b77-303d133636a8
15232024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_nexus_9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e
15242024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_nexus_dffbd7ed-3079-42a4-94f9-56c58e2ba053
15252024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_pantry_6bcfcbc1-742e-4ea0-9ef0-deabbba6d0f6
15262024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_pantry_694c58ca-a674-43bd-82f9-f9d312041dfb
15272024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_nexus_a9b1f633-c495-4741-93cc-68f7b3dbc9b0
15282024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_e74b2840-83c6-4e65-a3e2-eb76c6ca599c
15292024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_20270a34-9d4a-4540-9a1f-65aca8e7915f
15302024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_82554264-4b10-48cd-a9aa-ce0814c24bf9
15312024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_external_dns_195b4132-10e8-4727-b637-c30c31ace91e
15322024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_882765d7-a1fe-4ac6-913f-746a9fce9697
15332024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_3c79ae96-50ff-4e8f-9561-cc52684785e3
15342024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_e631441c-51d7-4658-bba3-9e904aea4a13
15352024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_oximeter_cb62ae02-880a-44c5-97f2-f6f20968779b
15362024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_8e2f8069-50d6-4ca3-8d6c-cb22bd5e2c6a
15372024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_external_dns_c5446ba5-3edb-4e71-ba5e-0d0043e3bc83
15382024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_clickhouse_78dcc329-b786-4ac2-98d7-e69f3b8429e4
15392024-06-06T21:20:40.474ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3054 zone = oxz_crucible_a4be2e7a-a8cc-4886-8fdd-f22edf8898fc
15402024-06-06T21:20:40.475ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15412024-06-06T21:20:40.487ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15422024-06-06T21:20:40.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 32866956 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36312 req_id = 93d0ad9f-dc60-48f7-8a2d-6291d0cd04a0 response_code = 204 uri = /omicron-zones
15432024-06-06T21:20:40.550ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1237
15442024-06-06T21:20:40.551ZINFOSledAgent (RSS): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15452024-06-06T21:20:40.551ZINFOSledAgent (RSS): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15462024-06-06T21:20:40.556ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:681
15472024-06-06T21:20:40.561ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:694
15482024-06-06T21:20:40.611ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV1 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { addresses: [ V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:818
15492024-06-06T21:20:42.550ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15502024-06-06T21:20:42.681ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15512024-06-06T21:20:42.763ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15522024-06-06T21:20:42.861ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15532024-06-06T21:20:43.024ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15542024-06-06T21:20:43.272ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15552024-06-06T21:20:43.402ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15562024-06-06T21:20:43.767ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15572024-06-06T21:20:44.047ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15582024-06-06T21:20:44.470ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15592024-06-06T21:20:45.197ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15602024-06-06T21:20:46.093ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15612024-06-06T21:20:46.773ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15622024-06-06T21:20:47.577ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15632024-06-06T21:20:48.164ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15642024-06-06T21:20:49.951ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15652024-06-06T21:20:51.091ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/2fb27e2a-d075-4483-ad8e-1f8ffb14ff73/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:880
15662024-06-06T21:20:53.337ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52541
15672024-06-06T21:20:53.337ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52541 req_id = 6bbf85dc-b48a-4be0-a99f-2c233734bebb response_code = 200 uri = /baseboard
15682024-06-06T21:20:54.508ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9d4e5667-d190-44de-a3a8-59e8f204c4f9", "content-length": "173", "date": "Thu, 06 Jun 2024 21:20:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c0aaf062-8365-4c9f-956d-e354db5eed54\"", request_id: "9d4e5667-d190-44de-a3a8-59e8f204c4f9" } file = sled-agent/src/rack_setup/service.rs:880
15692024-06-06T21:20:56.742ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e91207c5-29b9-4e37-bfbb-c96d6c51cb12", "content-length": "173", "date": "Thu, 06 Jun 2024 21:20:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c0aaf062-8365-4c9f-956d-e354db5eed54\"", request_id: "e91207c5-29b9-4e37-bfbb-c96d6c51cb12" } file = sled-agent/src/rack_setup/service.rs:880
15702024-06-06T21:20:59.019ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "04c50f34-0390-458f-b490-a43e334cb2ba", "content-length": "173", "date": "Thu, 06 Jun 2024 21:20:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c0aaf062-8365-4c9f-956d-e354db5eed54\"", request_id: "04c50f34-0390-458f-b490-a43e334cb2ba" } file = sled-agent/src/rack_setup/service.rs:880
15712024-06-06T21:21:04.055ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4192da8e-5065-435f-b443-f476f2bf1e60", "content-length": "173", "date": "Thu, 06 Jun 2024 21:21:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"c0aaf062-8365-4c9f-956d-e354db5eed54\"", request_id: "4192da8e-5065-435f-b443-f476f2bf1e60" } file = sled-agent/src/rack_setup/service.rs:880
15722024-06-06T21:21:08.648ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
15732024-06-06T21:21:08.746ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56620
15742024-06-06T21:21:08.749ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15752024-06-06T21:21:08.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 83814 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56620 req_id = cd61c762-d8e3-48ad-80ed-0ded70327d84 response_code = 200 uri = /inventory
15762024-06-06T21:21:08.833ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15772024-06-06T21:21:08.833ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/omicron-zones.json file = common/src/ledger.rs:177
15782024-06-06T21:21:08.836ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/omicron-zones.json file = common/src/ledger.rs:177
15792024-06-06T21:21:08.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56620 req_id = f6464c10-0782-455d-a611-26949065f313 response_code = 200 uri = /omicron-zones
15802024-06-06T21:21:09.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43677
15812024-06-06T21:21:09.724ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 27b4c230-03de-4e03-9477-77afea2ad0c6, kind: Service { id: 195b4132-10e8-4727-b637-c30c31ace91e }, name: Name("external-dns-195b4132-10e8-4727-b637-c30c31ace91e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 28])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 80079700-d5d4-4db6-b900-053961147838, kind: Service { id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 }, name: Name("external-dns-c5446ba5-3edb-4e71-ba5e-0d0043e3bc83"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b8f02c7-24b3-4bfb-8b43-71e7c3bc1912, kind: Service { id: a9b1f633-c495-4741-93cc-68f7b3dbc9b0 }, name: Name("nexus-a9b1f633-c495-4741-93cc-68f7b3dbc9b0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 8f450e43-fb82-424d-93ae-8706f0c64dd6, kind: Service { id: 9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e }, name: Name("nexus-9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed127a6b-6bcd-4179-86fc-e218f35f1bfc, kind: Service { id: dffbd7ed-3079-42a4-94f9-56c58e2ba053 }, name: Name("nexus-dffbd7ed-3079-42a4-94f9-56c58e2ba053"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15822024-06-06T21:21:09.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
15832024-06-06T21:21:09.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15842024-06-06T21:21:09.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15852024-06-06T21:21:09.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15862024-06-06T21:21:09.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15872024-06-06T21:21:09.724ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15882024-06-06T21:21:09.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1552 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43677 req_id = c53c60ff-d863-4392-90a3-5bd050473913 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15892024-06-06T21:21:09.725ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:890
15902024-06-06T21:21:09.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50402
15912024-06-06T21:21:09.897ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15922024-06-06T21:21:09.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89837 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50402 req_id = 063fcb10-e5ed-466a-8198-8da7d238cc0f response_code = 200 uri = /inventory
15932024-06-06T21:21:09.987ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15942024-06-06T21:21:09.987ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/config/omicron-zones.json file = common/src/ledger.rs:177
15952024-06-06T21:21:09.988ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/config/omicron-zones.json file = common/src/ledger.rs:177
15962024-06-06T21:21:09.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1975 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50402 req_id = 3e726324-1db1-43dd-844f-b08125a3a899 response_code = 200 uri = /omicron-zones
15972024-06-06T21:21:10.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47692
15982024-06-06T21:21:10.418ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 27b4c230-03de-4e03-9477-77afea2ad0c6, kind: Service { id: 195b4132-10e8-4727-b637-c30c31ace91e }, name: Name("external-dns-195b4132-10e8-4727-b637-c30c31ace91e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 28])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 80079700-d5d4-4db6-b900-053961147838, kind: Service { id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 }, name: Name("external-dns-c5446ba5-3edb-4e71-ba5e-0d0043e3bc83"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b8f02c7-24b3-4bfb-8b43-71e7c3bc1912, kind: Service { id: a9b1f633-c495-4741-93cc-68f7b3dbc9b0 }, name: Name("nexus-a9b1f633-c495-4741-93cc-68f7b3dbc9b0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 8f450e43-fb82-424d-93ae-8706f0c64dd6, kind: Service { id: 9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e }, name: Name("nexus-9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed127a6b-6bcd-4179-86fc-e218f35f1bfc, kind: Service { id: dffbd7ed-3079-42a4-94f9-56c58e2ba053 }, name: Name("nexus-dffbd7ed-3079-42a4-94f9-56c58e2ba053"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15992024-06-06T21:21:10.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
16002024-06-06T21:21:10.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16012024-06-06T21:21:10.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16022024-06-06T21:21:10.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16032024-06-06T21:21:10.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16042024-06-06T21:21:10.418ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16052024-06-06T21:21:10.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 909 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47692 req_id = adadd818-a890-4931-a5cb-8e73ca2aa5f5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16062024-06-06T21:21:10.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33980
16072024-06-06T21:21:10.443ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 27b4c230-03de-4e03-9477-77afea2ad0c6, kind: Service { id: 195b4132-10e8-4727-b637-c30c31ace91e }, name: Name("external-dns-195b4132-10e8-4727-b637-c30c31ace91e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 28])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 80079700-d5d4-4db6-b900-053961147838, kind: Service { id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 }, name: Name("external-dns-c5446ba5-3edb-4e71-ba5e-0d0043e3bc83"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b8f02c7-24b3-4bfb-8b43-71e7c3bc1912, kind: Service { id: a9b1f633-c495-4741-93cc-68f7b3dbc9b0 }, name: Name("nexus-a9b1f633-c495-4741-93cc-68f7b3dbc9b0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 8f450e43-fb82-424d-93ae-8706f0c64dd6, kind: Service { id: 9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e }, name: Name("nexus-9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed127a6b-6bcd-4179-86fc-e218f35f1bfc, kind: Service { id: dffbd7ed-3079-42a4-94f9-56c58e2ba053 }, name: Name("nexus-dffbd7ed-3079-42a4-94f9-56c58e2ba053"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16082024-06-06T21:21:10.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
16092024-06-06T21:21:10.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16102024-06-06T21:21:10.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16112024-06-06T21:21:10.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16122024-06-06T21:21:10.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16132024-06-06T21:21:10.443ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16142024-06-06T21:21:10.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33980 req_id = 02684d96-8a64-4611-b950-add7fc5ce79a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16152024-06-06T21:21:10.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52939
16162024-06-06T21:21:10.492ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 27b4c230-03de-4e03-9477-77afea2ad0c6, kind: Service { id: 195b4132-10e8-4727-b637-c30c31ace91e }, name: Name("external-dns-195b4132-10e8-4727-b637-c30c31ace91e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 28])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 80079700-d5d4-4db6-b900-053961147838, kind: Service { id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 }, name: Name("external-dns-c5446ba5-3edb-4e71-ba5e-0d0043e3bc83"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b8f02c7-24b3-4bfb-8b43-71e7c3bc1912, kind: Service { id: a9b1f633-c495-4741-93cc-68f7b3dbc9b0 }, name: Name("nexus-a9b1f633-c495-4741-93cc-68f7b3dbc9b0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 8f450e43-fb82-424d-93ae-8706f0c64dd6, kind: Service { id: 9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e }, name: Name("nexus-9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed127a6b-6bcd-4179-86fc-e218f35f1bfc, kind: Service { id: dffbd7ed-3079-42a4-94f9-56c58e2ba053 }, name: Name("nexus-dffbd7ed-3079-42a4-94f9-56c58e2ba053"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16172024-06-06T21:21:10.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
16182024-06-06T21:21:10.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16192024-06-06T21:21:10.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16202024-06-06T21:21:10.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16212024-06-06T21:21:10.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16222024-06-06T21:21:10.492ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16232024-06-06T21:21:10.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52939 req_id = 0dcdb430-8496-4d06-9397-94c189402c49 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16242024-06-06T21:21:22.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61587
16252024-06-06T21:21:22.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1686 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61587 req_id = 995385ac-7608-4069-94c9-0079c36c4a09 response_code = 200 uri = /v2p
16262024-06-06T21:21:22.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42621
16272024-06-06T21:21:22.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42621 req_id = 9c1d4392-96aa-4481-a6c5-b07a45a577df response_code = 200 uri = /v2p
16282024-06-06T21:21:22.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55968
16292024-06-06T21:21:22.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55968 req_id = 2d89a795-e980-4784-b7ea-15d99c6f6303 response_code = 200 uri = /v2p
16302024-06-06T21:21:22.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65459
16312024-06-06T21:21:22.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 82304 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65459 req_id = c967e4ee-aaf6-4ae9-a2f1-0e03c0c9cdff response_code = 204 uri = /switch-ports
16322024-06-06T21:21:22.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58939
16332024-06-06T21:21:22.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35821
16342024-06-06T21:21:22.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4508 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65459 req_id = 916c5825-8f08-434b-9e55-1794a960c684 response_code = 200 uri = /network-bootstore-config
16352024-06-06T21:21:22.371ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
16362024-06-06T21:21:22.372ZINFOSledAgent (bootstore): Writing ledger to /pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16372024-06-06T21:21:22.373ZINFOSledAgent (bootstore): Writing ledger to /pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16382024-06-06T21:21:22.377ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
16392024-06-06T21:21:22.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6504 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65459 req_id = 1dc26b20-3d03-46be-897e-2cfbfd4d3652 response_code = 204 uri = /network-bootstore-config
16402024-06-06T21:21:22.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49972 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58939 req_id = 104484d2-5b0e-4437-99be-04466e29a0ad response_code = 204 uri = /switch-ports
16412024-06-06T21:21:22.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 600 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58939 req_id = 459b2757-bc8f-4f30-a2a4-1874c74dfeda response_code = 200 uri = /network-bootstore-config
16422024-06-06T21:21:22.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 92442 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35821 req_id = e5200e92-5717-4d34-a1b4-6bce99a3d49f response_code = 204 uri = /switch-ports
16432024-06-06T21:21:22.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35821 req_id = 82491271-9d8d-46dc-b922-b5be24c8d837 response_code = 200 uri = /network-bootstore-config
16442024-06-06T21:21:23.372ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38794
16452024-06-06T21:21:23.372ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 114 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38794 req_id = f8ee5754-bb8e-4ea9-97be-e4d317db6ab2 response_code = 200 uri = /baseboard
16462024-06-06T21:21:45.102ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:34076 remote_addr = [fd00:1122:3344:101::d]:57128 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54
16472024-06-06T21:21:45.115ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 10878 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = 5ad47c72-b7a1-4efa-b749-c346818248ca response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
16482024-06-06T21:21:52.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47743
16492024-06-06T21:21:52.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1436 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47743 req_id = 3310f951-5643-4f39-b008-56f2811e50eb response_code = 200 uri = /v2p
16502024-06-06T21:21:52.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46046
16512024-06-06T21:21:52.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46046 req_id = d090704c-2e53-4574-ab3e-f61602f3663f response_code = 200 uri = /v2p
16522024-06-06T21:21:52.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37096
16532024-06-06T21:21:52.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37096 req_id = d9df9355-b256-41bd-8b02-ce25e81c722e response_code = 200 uri = /v2p
16542024-06-06T21:21:52.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59342
16552024-06-06T21:21:52.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59342 req_id = 7bac86f5-56a0-45dd-91b8-117a2ac315b4 response_code = 204 uri = /switch-ports
16562024-06-06T21:21:52.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61778
16572024-06-06T21:21:52.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59342 req_id = 6c77d841-d957-4800-b789-cd493b0c4d92 response_code = 200 uri = /network-bootstore-config
16582024-06-06T21:21:52.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59708
16592024-06-06T21:21:52.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61778 req_id = 28cde06a-f49b-426a-a2a7-5342c23c0b90 response_code = 204 uri = /switch-ports
16602024-06-06T21:21:52.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 630 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61778 req_id = f15664cd-5597-4356-b8ba-7ca8251f31b2 response_code = 200 uri = /network-bootstore-config
16612024-06-06T21:21:52.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 59086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59708 req_id = 9ef6bee4-5e82-458c-93e0-ce49b59ce7e1 response_code = 204 uri = /switch-ports
16622024-06-06T21:21:52.671ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59708 req_id = d7de7afd-bdc2-452b-b3c7-8085467b9161 response_code = 200 uri = /network-bootstore-config
16632024-06-06T21:21:53.407ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36516
16642024-06-06T21:21:53.408ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 733 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36516 req_id = cc13ceec-0b1c-4d6a-9276-4be5616dea4f response_code = 200 uri = /baseboard
16652024-06-06T21:22:15.101ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 509 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = ada87b53-a0b6-4fb3-bdd0-5a86d27a3d24 response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
16662024-06-06T21:22:22.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36116
16672024-06-06T21:22:22.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36116 req_id = 97a33ec0-d483-428b-ac47-616a1d9b171e response_code = 200 uri = /v2p
16682024-06-06T21:22:22.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37360
16692024-06-06T21:22:22.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37360 req_id = 43ee074a-2b8b-4d3f-964a-7c8bc8466b9f response_code = 200 uri = /v2p
16702024-06-06T21:22:22.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38965
16712024-06-06T21:22:22.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38965 req_id = fc5534d3-5511-4244-b431-034f496af297 response_code = 200 uri = /v2p
16722024-06-06T21:22:22.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36681
16732024-06-06T21:22:22.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36681 req_id = e8300fb9-4adb-4cbc-b977-80bacf61bfdc response_code = 204 uri = /switch-ports
16742024-06-06T21:22:22.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37242
16752024-06-06T21:22:22.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3798 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36681 req_id = 184d9d13-048c-45b2-a156-573eaaeae319 response_code = 200 uri = /network-bootstore-config
16762024-06-06T21:22:22.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42866 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37242 req_id = 8f1e2819-ee6c-48cb-ad59-9114951769b2 response_code = 204 uri = /switch-ports
16772024-06-06T21:22:22.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37242 req_id = 739c7d5f-8f26-4510-a633-eac3bceec95d response_code = 200 uri = /network-bootstore-config
16782024-06-06T21:22:22.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39187
16792024-06-06T21:22:22.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 36271 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39187 req_id = 0b9f8b56-939a-4207-9fe2-5a23905a1bb1 response_code = 204 uri = /switch-ports
16802024-06-06T21:22:22.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39187 req_id = 2a7c01f7-a1ca-435c-8df8-51c366284452 response_code = 200 uri = /network-bootstore-config
16812024-06-06T21:22:23.443ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50702
16822024-06-06T21:22:23.443ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 105 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50702 req_id = bbe4f792-7fbf-48b3-aa36-feff8d35bada response_code = 200 uri = /baseboard
16832024-06-06T21:22:40.815ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
16842024-06-06T21:22:45.101ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = 82501cbd-f67b-447a-a42a-90b8fe6c1703 response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
16852024-06-06T21:22:52.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44161
16862024-06-06T21:22:52.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1339 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44161 req_id = 213a1e05-8c72-44b2-8532-56de77090b94 response_code = 200 uri = /v2p
16872024-06-06T21:22:52.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61004
16882024-06-06T21:22:52.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61004 req_id = ed9d3da3-4fe0-40c1-882e-7df04d48e8eb response_code = 200 uri = /v2p
16892024-06-06T21:22:52.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42303
16902024-06-06T21:22:52.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42303 req_id = 9177a651-62d6-4533-b5c0-4b721a8edd2e response_code = 200 uri = /v2p
16912024-06-06T21:22:52.465ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45490
16922024-06-06T21:22:52.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48284 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45490 req_id = f84078fa-282b-4980-8d73-7856687e1685 response_code = 204 uri = /switch-ports
16932024-06-06T21:22:52.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33491
16942024-06-06T21:22:52.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4041 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45490 req_id = c1884814-23c6-408a-b777-f60ef209504e response_code = 200 uri = /network-bootstore-config
16952024-06-06T21:22:52.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46839 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33491 req_id = b8714468-6841-4e67-a99c-719b57948b5e response_code = 204 uri = /switch-ports
16962024-06-06T21:22:52.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33491 req_id = caf0046d-7ca8-4b8f-92ee-fadcf380ca14 response_code = 200 uri = /network-bootstore-config
16972024-06-06T21:22:52.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37938
16982024-06-06T21:22:52.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45389 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37938 req_id = 13b2ed6c-af55-4e5d-b4af-b2e96b722778 response_code = 204 uri = /switch-ports
16992024-06-06T21:22:52.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 652 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37938 req_id = f898a7ca-1ea8-4bbf-b6f7-44c2922855e7 response_code = 200 uri = /network-bootstore-config
17002024-06-06T21:22:53.477ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45949
17012024-06-06T21:22:53.477ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 92 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45949 req_id = c864b03f-b6b7-4f02-9f8d-9773028d5425 response_code = 200 uri = /baseboard
17022024-06-06T21:23:15.100ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 593 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = 42c9e15e-4a2d-41f9-807d-43578f279669 response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
17032024-06-06T21:23:22.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53869
17042024-06-06T21:23:22.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1466 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53869 req_id = b8dd6644-5dc2-439a-9c87-d355aa03b691 response_code = 200 uri = /v2p
17052024-06-06T21:23:22.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40859
17062024-06-06T21:23:22.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40859 req_id = c06e7444-7e6b-46dc-af75-e57cd7a4a583 response_code = 200 uri = /v2p
17072024-06-06T21:23:22.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57769
17082024-06-06T21:23:22.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57769 req_id = 89edcb91-f049-426a-90ea-19f7598f27dd response_code = 204 uri = /switch-ports
17092024-06-06T21:23:22.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65394
17102024-06-06T21:23:22.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 885 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65394 req_id = 986e8ce8-d1bc-471b-8e3d-11ccc9900696 response_code = 200 uri = /v2p
17112024-06-06T21:23:22.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 865 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57769 req_id = ebadc5e5-add0-40a5-ba90-a51abdcb4da2 response_code = 200 uri = /network-bootstore-config
17122024-06-06T21:23:22.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60811
17132024-06-06T21:23:22.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60811 req_id = fd850bbc-5305-46ae-a934-f34ccdca3c98 response_code = 204 uri = /switch-ports
17142024-06-06T21:23:22.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51736
17152024-06-06T21:23:22.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 840 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60811 req_id = 6b49f3ee-08be-44d4-8731-d49c55145734 response_code = 200 uri = /network-bootstore-config
17162024-06-06T21:23:22.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51736 req_id = 9a068420-ccaf-4d2f-9084-b85a785aa2e2 response_code = 204 uri = /switch-ports
17172024-06-06T21:23:22.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51736 req_id = cbc358d4-f13e-4b06-b94a-c4c8996bfb7d response_code = 200 uri = /network-bootstore-config
17182024-06-06T21:23:23.517ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55627
17192024-06-06T21:23:23.518ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 676 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55627 req_id = 99f3df03-4daa-4981-90ef-a20a6f90721d response_code = 200 uri = /baseboard
17202024-06-06T21:23:45.113ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 534 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = 2d5f8340-0cb0-4667-950f-77fd28abce41 response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
17212024-06-06T21:23:52.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50067
17222024-06-06T21:23:52.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50067 req_id = 481f2f6b-bac2-42b0-b61d-48bb81bf48af response_code = 200 uri = /v2p
17232024-06-06T21:23:52.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46035
17242024-06-06T21:23:52.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46035 req_id = 63439d5e-a3c1-40a1-a973-1b7d74add54b response_code = 200 uri = /v2p
17252024-06-06T21:23:52.366ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58738
17262024-06-06T21:23:52.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58738 req_id = ec42e9c3-77b6-4d60-8ef3-ec090fe936bb response_code = 204 uri = /switch-ports
17272024-06-06T21:23:52.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58738 req_id = b4a8dcfe-f88e-49e5-935d-3fb9eb37c5dd response_code = 200 uri = /network-bootstore-config
17282024-06-06T21:23:52.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39108
17292024-06-06T21:23:52.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39108 req_id = ddda17c5-f2da-4f1f-a97f-59cb6ca6d9f5 response_code = 200 uri = /v2p
17302024-06-06T21:23:52.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48684
17312024-06-06T21:23:52.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45218 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48684 req_id = 99b4a5a9-297b-4ee7-aa83-021feb4d8c4b response_code = 204 uri = /switch-ports
17322024-06-06T21:23:52.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43559
17332024-06-06T21:23:52.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3602 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48684 req_id = 703c7a26-dcf4-49ce-8ecc-894a65794f91 response_code = 200 uri = /network-bootstore-config
17342024-06-06T21:23:52.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45670 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43559 req_id = 17d96ce3-7088-4f89-9371-bde517018995 response_code = 204 uri = /switch-ports
17352024-06-06T21:23:52.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43559 req_id = e56e419c-a690-4582-9810-e8884c6ded86 response_code = 200 uri = /network-bootstore-config
17362024-06-06T21:23:53.550ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40437
17372024-06-06T21:23:53.550ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40437 req_id = d2653c17-ec19-468a-8ff0-355d6851b472 response_code = 200 uri = /baseboard
17382024-06-06T21:24:15.153ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 512 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = 9e3c9993-d623-460e-b704-0a883ac130e2 response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
17392024-06-06T21:24:22.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39814
17402024-06-06T21:24:22.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39814 req_id = fe1aa025-beda-43f5-8b14-500415b89f43 response_code = 200 uri = /v2p
17412024-06-06T21:24:22.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44033
17422024-06-06T21:24:22.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44033 req_id = 8e14dc20-6259-4a3c-a80d-741159295d47 response_code = 200 uri = /v2p
17432024-06-06T21:24:22.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40639
17442024-06-06T21:24:22.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40639 req_id = ac4ccfa8-664e-498d-bfef-228f056f96e2 response_code = 204 uri = /switch-ports
17452024-06-06T21:24:22.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61153
17462024-06-06T21:24:22.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61217
17472024-06-06T21:24:22.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40639 req_id = c6051178-b3e5-41b2-8fee-14d49d64426f response_code = 200 uri = /network-bootstore-config
17482024-06-06T21:24:22.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61153 req_id = 6b5f4b40-b024-41c0-895f-009e89c8cec9 response_code = 200 uri = /v2p
17492024-06-06T21:24:22.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42356 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61217 req_id = 2e379177-3e52-4740-9c23-82bc798dcffa response_code = 204 uri = /switch-ports
17502024-06-06T21:24:22.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61217 req_id = 811a7b8f-7375-48e2-a984-e3128777615c response_code = 200 uri = /network-bootstore-config
17512024-06-06T21:24:22.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43843
17522024-06-06T21:24:22.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42242 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43843 req_id = 9a416c3e-d4ab-4d25-a065-32b7bf33805d response_code = 204 uri = /switch-ports
17532024-06-06T21:24:22.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 690 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43843 req_id = 22ec013c-d36a-40f5-9d7a-60a4125fb715 response_code = 200 uri = /network-bootstore-config
17542024-06-06T21:24:23.583ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60752
17552024-06-06T21:24:23.583ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60752 req_id = deee1cbc-38e0-49e5-9ae9-5edc8bbdc28f response_code = 200 uri = /baseboard
17562024-06-06T21:24:45.153ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 608 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = 84a78a11-44d5-4044-8407-86c510ae932b response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
17572024-06-06T21:24:52.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36660
17582024-06-06T21:24:52.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36660 req_id = ad5e03db-fd85-4efa-ae81-6ebab65732c2 response_code = 200 uri = /v2p
17592024-06-06T21:24:52.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49284
17602024-06-06T21:24:52.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49284 req_id = bbbb3a74-d0c6-499a-ab03-2cf00059961f response_code = 200 uri = /v2p
17612024-06-06T21:24:52.372ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44663
17622024-06-06T21:24:52.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44663 req_id = 77ae9c2a-9f31-4f1d-86cf-cb390467b904 response_code = 200 uri = /v2p
17632024-06-06T21:24:52.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62945
17642024-06-06T21:24:52.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46776 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62945 req_id = 7f312c3e-138b-448b-b2b3-5b464d97ac2c response_code = 204 uri = /switch-ports
17652024-06-06T21:24:52.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 873 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62945 req_id = 0b48335e-1f78-4e97-9dd9-c2dd624ec7c2 response_code = 200 uri = /network-bootstore-config
17662024-06-06T21:24:52.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43364
17672024-06-06T21:24:52.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42030 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43364 req_id = 48a46b99-adfd-4d7a-832c-d89851fcacab response_code = 204 uri = /switch-ports
17682024-06-06T21:24:52.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43364 req_id = c2363148-e9c2-4ca3-a036-b134e70c2ca5 response_code = 200 uri = /network-bootstore-config
17692024-06-06T21:24:52.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64790
17702024-06-06T21:24:52.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 41315 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64790 req_id = b74e010f-bb6e-45c8-ab60-398981484680 response_code = 204 uri = /switch-ports
17712024-06-06T21:24:52.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64790 req_id = 8f1ea5b0-454d-48f1-bbb9-7151073beb64 response_code = 200 uri = /network-bootstore-config
17722024-06-06T21:24:53.618ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39889
17732024-06-06T21:24:53.618ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 82 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39889 req_id = 4dd01208-d4d4-4b8f-b538-31a91223f476 response_code = 200 uri = /baseboard
17742024-06-06T21:25:15.154ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 604 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = 0a355924-9490-4be3-9691-dda36e1cd702 response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
17752024-06-06T21:25:22.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48613
17762024-06-06T21:25:22.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48613 req_id = c82dd283-22ab-4203-a71d-ca9121b0eec4 response_code = 200 uri = /v2p
17772024-06-06T21:25:22.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56167
17782024-06-06T21:25:22.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56167 req_id = c7dfa81b-4eb3-4153-9f73-11636beeec65 response_code = 200 uri = /v2p
17792024-06-06T21:25:22.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62619
17802024-06-06T21:25:22.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45738 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62619 req_id = 24af73e4-ce06-44fd-9348-7cd1cc93094c response_code = 204 uri = /switch-ports
17812024-06-06T21:25:22.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62619 req_id = e4e75ffb-b511-49b4-ac39-210f379e19ae response_code = 200 uri = /network-bootstore-config
17822024-06-06T21:25:22.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48394
17832024-06-06T21:25:22.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48394 req_id = bec3c301-f390-4097-aa75-d16b295524c6 response_code = 200 uri = /v2p
17842024-06-06T21:25:22.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55976
17852024-06-06T21:25:22.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44171 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55976 req_id = c53e7421-db6b-4067-945d-73b354353f0b response_code = 204 uri = /switch-ports
17862024-06-06T21:25:22.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56402
17872024-06-06T21:25:22.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42797 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56402 req_id = 22673b8c-3e2c-4d4a-851a-922a820f6b3b response_code = 204 uri = /switch-ports
17882024-06-06T21:25:22.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 853 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55976 req_id = 31ddc68f-8b61-410f-9eb9-06e6095ee546 response_code = 200 uri = /network-bootstore-config
17892024-06-06T21:25:22.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56402 req_id = 35e19974-6a4e-420f-a8e7-5a2523666833 response_code = 200 uri = /network-bootstore-config
17902024-06-06T21:25:23.650ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54326
17912024-06-06T21:25:23.650ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 79 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54326 req_id = 4cabfbe9-c432-4d8c-8f6c-51a798f11ce1 response_code = 200 uri = /baseboard
17922024-06-06T21:25:45.154ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 546 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = 96b44e4f-2f66-4dfd-8b82-314b57fe46c3 response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
17932024-06-06T21:25:52.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59185
17942024-06-06T21:25:52.224ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59185 req_id = 89dde17c-7432-4141-bc21-b54880fc01bd response_code = 200 uri = /v2p
17952024-06-06T21:25:52.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37220
17962024-06-06T21:25:52.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37220 req_id = f565058f-4860-4cce-88dd-31b27eb6c5ab response_code = 200 uri = /v2p
17972024-06-06T21:25:52.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42996
17982024-06-06T21:25:52.415ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 27b4c230-03de-4e03-9477-77afea2ad0c6, kind: Service { id: 195b4132-10e8-4727-b637-c30c31ace91e }, name: Name("external-dns-195b4132-10e8-4727-b637-c30c31ace91e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 28])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 80079700-d5d4-4db6-b900-053961147838, kind: Service { id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 }, name: Name("external-dns-c5446ba5-3edb-4e71-ba5e-0d0043e3bc83"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b8f02c7-24b3-4bfb-8b43-71e7c3bc1912, kind: Service { id: a9b1f633-c495-4741-93cc-68f7b3dbc9b0 }, name: Name("nexus-a9b1f633-c495-4741-93cc-68f7b3dbc9b0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 8f450e43-fb82-424d-93ae-8706f0c64dd6, kind: Service { id: 9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e }, name: Name("nexus-9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed127a6b-6bcd-4179-86fc-e218f35f1bfc, kind: Service { id: dffbd7ed-3079-42a4-94f9-56c58e2ba053 }, name: Name("nexus-dffbd7ed-3079-42a4-94f9-56c58e2ba053"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17992024-06-06T21:25:52.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
18002024-06-06T21:25:52.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18012024-06-06T21:25:52.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18022024-06-06T21:25:52.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18032024-06-06T21:25:52.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18042024-06-06T21:25:52.415ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18052024-06-06T21:25:52.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42996 req_id = ad410a79-1ab6-4846-bafc-fb2a5cc60004 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18062024-06-06T21:25:52.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51933
18072024-06-06T21:25:52.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51933 req_id = 04b9c707-ca66-4484-83b8-b5f3473edfb7 response_code = 200 uri = /v2p
18082024-06-06T21:25:52.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38955
18092024-06-06T21:25:52.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46658 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38955 req_id = 1d99f520-b47e-4bac-ac44-7450161cb36d response_code = 204 uri = /switch-ports
18102024-06-06T21:25:52.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36387
18112024-06-06T21:25:52.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58399
18122024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 27b4c230-03de-4e03-9477-77afea2ad0c6, kind: Service { id: 195b4132-10e8-4727-b637-c30c31ace91e }, name: Name("external-dns-195b4132-10e8-4727-b637-c30c31ace91e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 28])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 80079700-d5d4-4db6-b900-053961147838, kind: Service { id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 }, name: Name("external-dns-c5446ba5-3edb-4e71-ba5e-0d0043e3bc83"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b8f02c7-24b3-4bfb-8b43-71e7c3bc1912, kind: Service { id: a9b1f633-c495-4741-93cc-68f7b3dbc9b0 }, name: Name("nexus-a9b1f633-c495-4741-93cc-68f7b3dbc9b0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 8f450e43-fb82-424d-93ae-8706f0c64dd6, kind: Service { id: 9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e }, name: Name("nexus-9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed127a6b-6bcd-4179-86fc-e218f35f1bfc, kind: Service { id: dffbd7ed-3079-42a4-94f9-56c58e2ba053 }, name: Name("nexus-dffbd7ed-3079-42a4-94f9-56c58e2ba053"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18132024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
18142024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18152024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 27b4c230-03de-4e03-9477-77afea2ad0c6, kind: Service { id: 195b4132-10e8-4727-b637-c30c31ace91e }, name: Name("external-dns-195b4132-10e8-4727-b637-c30c31ace91e"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 28])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 80079700-d5d4-4db6-b900-053961147838, kind: Service { id: c5446ba5-3edb-4e71-ba5e-0d0043e3bc83 }, name: Name("external-dns-c5446ba5-3edb-4e71-ba5e-0d0043e3bc83"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 134])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7b8f02c7-24b3-4bfb-8b43-71e7c3bc1912, kind: Service { id: a9b1f633-c495-4741-93cc-68f7b3dbc9b0 }, name: Name("nexus-a9b1f633-c495-4741-93cc-68f7b3dbc9b0"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 58])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 8f450e43-fb82-424d-93ae-8706f0c64dd6, kind: Service { id: 9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e }, name: Name("nexus-9fe08ae3-c2c2-4419-bec9-7e5e2ca0ee7e"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 158, 103])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed127a6b-6bcd-4179-86fc-e218f35f1bfc, kind: Service { id: dffbd7ed-3079-42a4-94f9-56c58e2ba053 }, name: Name("nexus-dffbd7ed-3079-42a4-94f9-56c58e2ba053"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18162024-06-06T21:25:52.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38955 req_id = ccea2adb-d463-4fd2-9483-14b48e9ce0c9 response_code = 200 uri = /network-bootstore-config
18172024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18182024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18192024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18202024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18212024-06-06T21:25:52.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 489 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36387 req_id = bde246d9-9065-4f74-b540-e74d14cc3f86 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18222024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
18232024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18242024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18252024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18262024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18272024-06-06T21:25:52.526ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18282024-06-06T21:25:52.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 529 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58399 req_id = f2d692df-248a-442b-bc6e-fa02f740be9b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18292024-06-06T21:25:52.598ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40147
18302024-06-06T21:25:52.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40147 req_id = 21c2c968-c8e1-44af-955e-3c78ee95d79c response_code = 204 uri = /switch-ports
18312024-06-06T21:25:52.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52705
18322024-06-06T21:25:52.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40147 req_id = d4c9aa79-1c7b-441d-a627-ef3df543a694 response_code = 200 uri = /network-bootstore-config
18332024-06-06T21:25:52.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42853 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52705 req_id = b21d5f48-1e9e-4c12-b187-4bf81dd2c5cf response_code = 204 uri = /switch-ports
18342024-06-06T21:25:52.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52705 req_id = a6fed7aa-d305-468a-ae32-5ead96e0f17c response_code = 200 uri = /network-bootstore-config
18352024-06-06T21:25:53.683ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62366
18362024-06-06T21:25:53.683ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 99 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62366 req_id = 665a41b4-6818-4f9c-94c3-b8048c7c0c0d response_code = 200 uri = /baseboard
18372024-06-06T21:26:15.154ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 597 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = 8ef0a510-eb55-4225-b9a2-82bcf4d5e904 response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
18382024-06-06T21:26:22.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52089
18392024-06-06T21:26:22.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52089 req_id = 9cfbfa64-4de9-4493-996e-5e24c307369b response_code = 200 uri = /v2p
18402024-06-06T21:26:22.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51977
18412024-06-06T21:26:22.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51977 req_id = abbad298-a665-4a3d-96f6-61acfc6fa3f8 response_code = 200 uri = /v2p
18422024-06-06T21:26:22.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39901
18432024-06-06T21:26:22.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45756 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39901 req_id = 7ffa852e-d456-4fe5-8e74-167ecf3a1671 response_code = 204 uri = /switch-ports
18442024-06-06T21:26:22.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36417
18452024-06-06T21:26:22.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39901 req_id = 2c9134cb-42c8-4337-8618-e83f37c3fd26 response_code = 200 uri = /network-bootstore-config
18462024-06-06T21:26:22.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39066
18472024-06-06T21:26:22.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39066 req_id = a35e1b5c-efff-4d13-a2f5-38c09eb40499 response_code = 200 uri = /v2p
18482024-06-06T21:26:22.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36417 req_id = 534f7ce7-1363-488d-a2ef-92366189c07c response_code = 204 uri = /switch-ports
18492024-06-06T21:26:22.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 632 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36417 req_id = ba117c64-c192-44c3-85d8-d0daca167b77 response_code = 200 uri = /network-bootstore-config
18502024-06-06T21:26:22.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34080
18512024-06-06T21:26:22.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43086 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34080 req_id = 4789a262-b246-4608-8e58-a927f0d780de response_code = 204 uri = /switch-ports
18522024-06-06T21:26:22.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 713 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34080 req_id = 8a9a10fb-014f-4c3d-ad8a-965908623eb3 response_code = 200 uri = /network-bootstore-config
18532024-06-06T21:26:23.716ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39385
18542024-06-06T21:26:23.717ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39385 req_id = 3840c3f7-a7a7-407b-8dd1-70a170aa8f05 response_code = 200 uri = /baseboard
18552024-06-06T21:26:33.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45447
18562024-06-06T21:26:33.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45447 req_id = e2bbc8bb-62d2-4de9-bf6d-33d3fe139b5d response_code = 200 uri = /v2p
18572024-06-06T21:26:33.788ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(2287268) }
18582024-06-06T21:26:33.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45447 req_id = f2555def-775d-40bc-a919-01585e59a6c1 response_code = 204 uri = /v2p
18592024-06-06T21:26:33.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44553
18602024-06-06T21:26:33.954ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:546 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5f2226e8-3d5f-4cb0-bed8-5552934680df, kind: Instance { id: 1e290323-73ce-400d-8c32-aa10bd54d95f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2287268), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5f2226e8-3d5f-4cb0-bed8-5552934680df, kind: Instance { id: 1e290323-73ce-400d-8c32-aa10bd54d95f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2287268), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5f2226e8-3d5f-4cb0-bed8-5552934680df, kind: Instance { id: 1e290323-73ce-400d-8c32-aa10bd54d95f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2287268), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(2287268))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5f2226e8-3d5f-4cb0-bed8-5552934680df, kind: Instance { id: 1e290323-73ce-400d-8c32-aa10bd54d95f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2287268), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-e38ac095fa", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 329b52a7-de8e-4c1d-8784-11185dbce328, read_only_parent: Some(Volume { block_size: 512, id: 674870e1-81be-4904-9dfd-dfb465f5926e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2ef716c6-4e54-44d7-9d8e-b383a056f5f0, key: Some("MMCuIasySpqBTKC8KP3e9X5owTVqShzWH8diIcTKzJ0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 329b52a7-de8e-4c1d-8784-11185dbce328, key: Some("UY4pw5CecI8gAGdsP/bJvxL9mpfcdJV16Sa29tnHDM8="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::19]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAC+UKvGWMZYAABQq8ZYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAvlCrxljGWAAAUKvGWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIxZTI5MDMyMy03M2NlLTQwMGQtOGMzMi1hYTEwYmQ1NGQ5NWYiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTHdiZzRPWE5ZdTBkakx4c0x3MXNrR3hMVHNwaXJoMmt0MTZ2ZXBUQ1FaVSJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f instance_runtime = InstanceRuntimeState { propolis_id: Some(bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-06T21:26:33.581289913Z } metadata = InstanceMetadata { silo_id: 400f104f-8c96-4ad1-975a-61efc576255b, project_id: c19cf8b2-4922-4c82-b8bc-1b3ca067e378 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-06T21:26:33.530697Z }
18612024-06-06T21:26:33.955ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:580 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18622024-06-06T21:26:33.956ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:938 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f propolis_id = bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5f2226e8-3d5f-4cb0-bed8-5552934680df, kind: Instance { id: 1e290323-73ce-400d-8c32-aa10bd54d95f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2287268), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5f2226e8-3d5f-4cb0-bed8-5552934680df, kind: Instance { id: 1e290323-73ce-400d-8c32-aa10bd54d95f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2287268), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5f2226e8-3d5f-4cb0-bed8-5552934680df, kind: Instance { id: 1e290323-73ce-400d-8c32-aa10bd54d95f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2287268), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(2287268))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5f2226e8-3d5f-4cb0-bed8-5552934680df, kind: Instance { id: 1e290323-73ce-400d-8c32-aa10bd54d95f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(2287268), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-e38ac095fa", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 329b52a7-de8e-4c1d-8784-11185dbce328, read_only_parent: Some(Volume { block_size: 512, id: 674870e1-81be-4904-9dfd-dfb465f5926e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2ef716c6-4e54-44d7-9d8e-b383a056f5f0, key: Some("MMCuIasySpqBTKC8KP3e9X5owTVqShzWH8diIcTKzJ0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 329b52a7-de8e-4c1d-8784-11185dbce328, key: Some("UY4pw5CecI8gAGdsP/bJvxL9mpfcdJV16Sa29tnHDM8="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::19]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAC+UKvGWMZYAABQq8ZYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAvlCrxljGWAAAUKvGWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIxZTI5MDMyMy03M2NlLTQwMGQtOGMzMi1hYTEwYmQ1NGQ5NWYiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTHdiZzRPWE5ZdTBkakx4c0x3MXNrR3hMVHNwaXJoMmt0MTZ2ZXBUQ1FaVSJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-06T21:26:33.581289913Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-06T21:26:33.530697Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
18632024-06-06T21:26:33.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 14126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44553 req_id = f93171e0-8a0f-4649-8e4a-d40bacf272a9 response_code = 200 uri = /instances/1e290323-73ce-400d-8c32-aa10bd54d95f
18642024-06-06T21:26:34.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47123
18652024-06-06T21:26:34.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 858 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47123 req_id = e2f322ef-7dc1-4a92-ae32-910e328a558e response_code = 200 uri = /instances/1e290323-73ce-400d-8c32-aa10bd54d95f/state
18662024-06-06T21:26:34.093ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 254, 215, 254]), slot: 0, vni: Vni { inner: 2287268 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
18672024-06-06T21:26:34.094ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
18682024-06-06T21:26:34.127ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483 file = illumos-utils/src/zone.rs:315 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18692024-06-06T21:26:34.149ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483 file = illumos-utils/src/zone.rs:354 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18702024-06-06T21:26:35.430ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::b]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18712024-06-06T21:26:35.430ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f zone = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18722024-06-06T21:26:35.601ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 41.116858ms file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f zone = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18732024-06-06T21:26:35.652ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 98.934357ms file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f zone = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18742024-06-06T21:26:35.768ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 221.557607ms file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f zone = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18752024-06-06T21:26:36.007ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 427.320897ms file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f zone = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18762024-06-06T21:26:36.449ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 1.075937594s file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f zone = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18772024-06-06T21:26:37.535ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 581.072671ms file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f zone = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18782024-06-06T21:26:38.127ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 1.215328425s file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f zone = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18792024-06-06T21:26:39.352ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 1.446840755s file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f zone = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18802024-06-06T21:26:40.827ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483 file = sled-agent/src/instance.rs:1423 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18812024-06-06T21:26:40.834ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 54.001707ms file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18822024-06-06T21:26:40.897ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483") failed: Property not found. retry in 127.033824ms file = illumos-utils/src/svc.rs:36 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18832024-06-06T21:26:41.034ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1432 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18842024-06-06T21:26:41.070ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1446 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18852024-06-06T21:26:41.071ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAC+UKvGWMZYAABQq8ZYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAvlCrxljGWAAAUKvGWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIxZTI5MDMyMy03M2NlLTQwMGQtOGMzMi1hYTEwYmQ1NGQ5NWYiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTHdiZzRPWE5ZdTBkakx4c0x3MXNrR3hMVHNwaXJoMmt0MTZ2ZXBUQ1FaVSJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-e38ac095fa", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 329b52a7-de8e-4c1d-8784-11185dbce328, read_only_parent: Some(Volume { block_size: 512, id: 674870e1-81be-4904-9dfd-dfb465f5926e, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2ef716c6-4e54-44d7-9d8e-b383a056f5f0, key: Some("MMCuIasySpqBTKC8KP3e9X5owTVqShzWH8diIcTKzJ0="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 329b52a7-de8e-4c1d-8784-11185dbce328, key: Some("UY4pw5CecI8gAGdsP/bJvxL9mpfcdJV16Sa29tnHDM8="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::16]:19001", "[fd00:1122:3344:101::19]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: 1e290323-73ce-400d-8c32-aa10bd54d95f, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: c19cf8b2-4922-4c82-b8bc-1b3ca067e378, silo_id: 400f104f-8c96-4ad1-975a-61efc576255b }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:685 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18862024-06-06T21:26:41.181ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:687 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18872024-06-06T21:26:41.184ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-06-06T21:26:41.182654055Z } file = sled-agent/src/instance.rs:569 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18882024-06-06T21:26:41.184ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f new_instance_state = InstanceRuntimeState { propolis_id: Some(bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-06T21:26:33.581289913Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-06T21:26:41.182654055Z } propolis_id = bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18892024-06-06T21:26:41.184ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-06T21:26:33.581289913Z }, propolis_id: bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483, vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-06T21:26:41.182654055Z } }
18902024-06-06T21:26:41.292ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-06-06T21:26:41.292232791Z } file = sled-agent/src/instance.rs:569 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18912024-06-06T21:26:41.292ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f new_instance_state = InstanceRuntimeState { propolis_id: Some(bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-06T21:26:33.581289913Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-06T21:26:41.292232791Z } propolis_id = bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18922024-06-06T21:26:41.292ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-06T21:26:33.581289913Z }, propolis_id: bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483, vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-06T21:26:41.292232791Z } }
18932024-06-06T21:26:45.256ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 562 local_addr = [fd00:1122:3344:101::1]:34076 method = GET remote_addr = [fd00:1122:3344:101::d]:57128 req_id = bc578611-2958-4168-8bcc-92fa435570d3 response_code = 200 sled_id = c0aaf062-8365-4c9f-956d-e354db5eed54 uri = /c0aaf062-8365-4c9f-956d-e354db5eed54
18942024-06-06T21:26:51.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64908
18952024-06-06T21:26:51.419ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64908 req_id = 28079f8a-9c22-43c1-bfe9-e0e520e67277 response_code = 200 uri = /instances/1e290323-73ce-400d-8c32-aa10bd54d95f/state
18962024-06-06T21:26:51.419ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-06-06T21:26:51.419261998Z } file = sled-agent/src/instance.rs:569 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
18972024-06-06T21:26:51.419ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f new_instance_state = InstanceRuntimeState { propolis_id: Some(bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-06T21:26:33.581289913Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-06T21:26:51.419261998Z } propolis_id = bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
18982024-06-06T21:26:51.419ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-06T21:26:33.581289913Z }, propolis_id: bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483, vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-06T21:26:51.419261998Z } }
18992024-06-06T21:26:51.467ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-06-06T21:26:51.467571762Z } file = sled-agent/src/instance.rs:569 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
19002024-06-06T21:26:51.467ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-06T21:26:51.467571762Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-06-06T21:26:51.467571762Z } propolis_id = bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
19012024-06-06T21:26:51.467ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:606 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
19022024-06-06T21:26:51.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19032024-06-06T21:26:51.469ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19042024-06-06T21:26:51.469ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/23979605-f70d-4d65-a562-1e28a51e0b00/debug/bundle/zone", "/pool/int/7d687f62-3d4a-451a-813f-806af5d7ee6f/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/c41774fe-e97b-4da8-a02e-62aed7a76752/crypt/debug", "/pool/ext/47f7d0a6-6130-40ca-bb5d-75ec1ac4ac8a/crypt/debug", "/pool/ext/f6dd5f2f-2dc6-423f-b61b-4d7180ca3c25/crypt/debug", "/pool/ext/be2ad19f-eecd-4c88-9423-9dddb68b99b1/crypt/debug", "/pool/ext/961e4b4e-d0f9-407e-bfb2-d5acdae78dc1/crypt/debug", "/pool/ext/0d4507b2-f585-45d8-bb5b-916ef11d551a/crypt/debug", "/pool/ext/ef1e5a4a-45ea-4e3a-b30e-1c88fb47c798/crypt/debug", "/pool/ext/f940f667-095d-47e9-b4e9-c42a00bc2822/crypt/debug", "/pool/ext/02a90705-a0f8-48c6-a1ce-d34d36f64f29/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483
19052024-06-06T21:26:52.119ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483", bundle_id: ecc4d77d-96f5-4607-9f87-d97a067d48be }, time_created: 2024-06-06T21:26:51.470157720Z, version: 0, cause: TerminatedInstance }
19062024-06-06T21:26:52.119ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483 file = sled-agent/src/instance.rs:780 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
19072024-06-06T21:26:52.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58222
19082024-06-06T21:26:52.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58621
19092024-06-06T21:26:52.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58621 req_id = 43c98c50-bedf-44cf-8ec3-45fdf087aa8f response_code = 200 uri = /v2p
19102024-06-06T21:26:52.221ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:671 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 254, 215, 254])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(2287268) }
19112024-06-06T21:26:52.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:58621 req_id = deea1e76-a2ee-4d6c-a525-e513dedf37af response_code = 204 uri = /v2p
19122024-06-06T21:26:52.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52924
19132024-06-06T21:26:52.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36924
19142024-06-06T21:26:52.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58164
19152024-06-06T21:26:52.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58164 req_id = ca4058ff-31c2-4400-a4f7-492b7b49d004 response_code = 200 uri = /v2p
19162024-06-06T21:26:52.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52323
19172024-06-06T21:26:52.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 898 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52323 req_id = edaae934-f726-456b-8de7-75ef1d96ba99 response_code = 200 uri = /v2p
19182024-06-06T21:26:52.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47254
19192024-06-06T21:26:52.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50301 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47254 req_id = bb886b93-625d-4b26-94e5-d63490d5230c response_code = 204 uri = /switch-ports
19202024-06-06T21:26:52.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47254 req_id = c6299ff0-d1e7-455d-bcf3-200929aefcfe response_code = 200 uri = /network-bootstore-config
19212024-06-06T21:26:52.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43355
19222024-06-06T21:26:52.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 41608 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43355 req_id = a0302729-5553-46b7-b903-53bec012e646 response_code = 204 uri = /switch-ports
19232024-06-06T21:26:52.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55351
19242024-06-06T21:26:52.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43355 req_id = 459bf3b2-fbcb-43aa-8b7e-8ba1093e513f response_code = 200 uri = /network-bootstore-config
19252024-06-06T21:26:52.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44279 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55351 req_id = 7f3fae67-c918-4a10-9bd1-9807ce4f14a8 response_code = 204 uri = /switch-ports
19262024-06-06T21:26:52.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55351 req_id = 74593da5-0cbd-4b38-ac21-f7baae871e7c response_code = 200 uri = /network-bootstore-config
19272024-06-06T21:26:53.749ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58377
19282024-06-06T21:26:53.749ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 111 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58377 req_id = ce903ab4-e36d-4927-8d17-60a8fc524fb0 response_code = 200 uri = /baseboard
19292024-06-06T21:26:53.879ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
19302024-06-06T21:26:53.905ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-06T21:26:51.467571762Z }, propolis_id: bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-06T21:26:53.905393032Z } }
19312024-06-06T21:26:53.978ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33856
19322024-06-06T21:26:53.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 780 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33856 req_id = f7716ca0-0d72-490c-b5bf-e3d2b7bb994f response_code = 200 uri = /v2p
19332024-06-06T21:26:54.164ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-06T21:26:51.467571762Z }, propolis_id: bdd7bd75-ac37-4c85-a8d8-68f9b5d8f483, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-06T21:26:53.905393032Z } }
19342024-06-06T21:26:54.170ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:723 instance_id = 1e290323-73ce-400d-8c32-aa10bd54d95f
19352024-06-06T21:26:54.262ZWARNSledAgent (InstanceManager): Error handling request err = Instance(RequestDropped(RecvError(()))) file = sled-agent/src/instance_manager.rs:502 request = GetState
19362024-06-06T21:26:54.263ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Not Found error_message_internal = No such instance ID: 1e290323-73ce-400d-8c32-aa10bd54d95f file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 1922018 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36924 req_id = c1f9df67-ffb6-4956-acf8-c9389266c056 response_code = 404 uri = /instances/1e290323-73ce-400d-8c32-aa10bd54d95f/state
19372024-06-06T21:26:54.263ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Not Found error_message_internal = No such instance ID: 1e290323-73ce-400d-8c32-aa10bd54d95f file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 2020641 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52924 req_id = d7f721c4-ee1f-4c08-8223-3e4fd7d493c5 response_code = 404 uri = /instances/1e290323-73ce-400d-8c32-aa10bd54d95f/state
19382024-06-06T21:26:54.263ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Error managing instances: Instance Manager dropped our request file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 2057573 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58222 req_id = 8dc27d6c-9bf8-474f-888a-e7b1f13a28d4 response_code = 500 uri = /instances/1e290323-73ce-400d-8c32-aa10bd54d95f/state
19392024-06-06T21:26:54.335ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35362
19402024-06-06T21:26:54.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35362 req_id = c2a30036-2667-411a-ac65-0f215f8da57c response_code = 200 uri = /v2p