Max level shown:
1 [ May 16 00:41:38 Enabled. ]
2 [ May 16 00:41:38 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ May 16 00:41:38 Method "start" exited with status 0. ]
4 [ May 16 00:41:38 Rereading configuration. ]
5 [ May 16 00:41:38 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-05-16T00:41:38.615ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-05-16T00:41:38.615ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-05-16T00:41:38.668ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-05-16T00:41:38.668ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-05-16T00:41:38.783ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-05-16T00:41:38.791ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-05-16T00:41:38.799ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-05-16T00:41:39.402ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:a02a::, len: 64 }
152024-05-16T00:41:39.538ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-05-16T00:41:39.538ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-05-16T00:41:39.538ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-05-16T00:41:39.538ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-05-16T00:41:39.538ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:625
202024-05-16T00:41:39.538ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:506
212024-05-16T00:41:39.541ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
222024-05-16T00:41:39.541ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:674
232024-05-16T00:41:39.541ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242024-05-16T00:41:39.541ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:733
252024-05-16T00:41:39.541ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
262024-05-16T00:41:39.541ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = None
272024-05-16T00:41:39.541ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
282024-05-16T00:41:39.541ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
292024-05-16T00:41:39.541ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" } path = /scratch/m2_0.vdev
302024-05-16T00:41:39.553ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:304
312024-05-16T00:41:39.553ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool)
322024-05-16T00:41:39.653ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal }
332024-05-16T00:41:39.857ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
342024-05-16T00:41:39.857ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
352024-05-16T00:41:39.857ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
362024-05-16T00:41:39.857ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
372024-05-16T00:41:39.857ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
382024-05-16T00:41:39.857ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }
392024-05-16T00:41:39.857ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" } path = /scratch/m2_1.vdev
402024-05-16T00:41:39.866ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:304
412024-05-16T00:41:39.866ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool)
422024-05-16T00:41:39.953ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal }
432024-05-16T00:41:40.162ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
442024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
452024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
462024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
472024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
482024-05-16T00:41:40.162ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
492024-05-16T00:41:40.162ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
502024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
512024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
522024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
532024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-05-16T00:41:40.162ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
552024-05-16T00:41:40.162ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
562024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
572024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
582024-05-16T00:41:40.162ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
592024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
602024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
612024-05-16T00:41:40.162ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
622024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
632024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
642024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
652024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
662024-05-16T00:41:40.162ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
672024-05-16T00:41:40.162ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
682024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
692024-05-16T00:41:40.162ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
702024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
712024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
722024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
732024-05-16T00:41:40.162ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
742024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
752024-05-16T00:41:40.162ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
762024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
772024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
782024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
792024-05-16T00:41:40.162ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
802024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
812024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
822024-05-16T00:41:40.162ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
832024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
842024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
852024-05-16T00:41:40.162ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
862024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
872024-05-16T00:41:40.162ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
882024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
892024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
902024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
912024-05-16T00:41:40.162ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
922024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
932024-05-16T00:41:40.162ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
942024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
952024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
962024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
972024-05-16T00:41:40.162ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
982024-05-16T00:41:40.162ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
992024-05-16T00:41:40.162ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" } file = sled-agent/src/long_running_tasks.rs:93
1002024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1012024-05-16T00:41:40.162ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1022024-05-16T00:41:40.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1032024-05-16T00:41:40.162ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
1042024-05-16T00:41:40.162ZINFOSledAgent (bootstore): No ledger in /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-05-16T00:41:40.162ZINFOSledAgent (bootstore): No ledger in /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-05-16T00:41:40.162ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-05-16T00:41:40.162ZINFOSledAgent (bootstore): No ledger in /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-05-16T00:41:40.162ZINFOSledAgent (bootstore): No ledger in /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-05-16T00:41:40.162ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-05-16T00:41:40.162ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
1112024-05-16T00:41:40.162ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
1122024-05-16T00:41:40.173ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:711
1132024-05-16T00:41:40.174ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1565, tv_nsec: 256853528 } time_to_next_cleanup = 599.999931968s
1142024-05-16T00:41:40.174ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3617
1152024-05-16T00:41:40.174ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1162024-05-16T00:41:40.174ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-05-16T00:41:40.174ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-05-16T00:41:40.177ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:196 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-05-16T00:41:40.177ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-05-16T00:41:40.177ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 24, }, ), ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1003
1212024-05-16T00:41:40.177ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-05-16T00:41:40.177ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1232024-05-16T00:41:40.177ZINFOSledAgent (RSS): No ledger in /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-05-16T00:41:40.177ZINFOSledAgent (RSS): No ledger in /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-05-16T00:41:40.177ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1063
1262024-05-16T00:41:40.177ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1272024-05-16T00:41:40.177ZINFOSledAgent (RSS): No ledger in /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-05-16T00:41:40.177ZINFOSledAgent (RSS): No ledger in /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-05-16T00:41:40.177ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1104
1302024-05-16T00:41:40.177ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:118
1312024-05-16T00:41:40.177ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:91
1322024-05-16T00:41:40.177ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1332024-05-16T00:41:40.177ZINFOSledAgent (RSS): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-05-16T00:41:40.178ZINFOSledAgent (RSS): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-05-16T00:41:40.178ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:138
1362024-05-16T00:41:40.178ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1137
1372024-05-16T00:41:40.178ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-05-16T00:41:40.178ZINFOSledAgent (bootstore): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-05-16T00:41:40.178ZINFOSledAgent (bootstore): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-05-16T00:41:40.178ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-05-16T00:41:40.178ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ebcdcaed-e48b-4070-ab17-779f5ea072cb, rack_id: 22aa8733-7ad9-4e21-be17-4210dcf48a5e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-05-16T00:41:40.178ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:41509
1432024-05-16T00:41:40.179ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ebcdcaed-e48b-4070-ab17-779f5ea072cb, rack_id: 22aa8733-7ad9-4e21-be17-4210dcf48a5e, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } file = sled-agent/src/bootstrap/server.rs:360
1442024-05-16T00:41:40.179ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1452024-05-16T00:41:40.179ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1462024-05-16T00:41:40.179ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1472024-05-16T00:41:40.179ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1482024-05-16T00:41:40.179ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1492024-05-16T00:41:40.179ZINFOSledAgent (StorageManager): No ledger in /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1502024-05-16T00:41:40.179ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1512024-05-16T00:41:40.179ZINFOSledAgent (StorageManager): No ledger in /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-05-16T00:41:40.179ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1532024-05-16T00:41:40.179ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1542024-05-16T00:41:40.182ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3849
1552024-05-16T00:41:40.192ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
1562024-05-16T00:41:40.201ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
1572024-05-16T00:41:40.211ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
1582024-05-16T00:41:40.220ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
1592024-05-16T00:41:40.228ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
1602024-05-16T00:41:40.238ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
1612024-05-16T00:41:40.247ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
1622024-05-16T00:41:40.255ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
1632024-05-16T00:41:40.263ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
1642024-05-16T00:41:40.263ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1652024-05-16T00:41:40.263ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1662024-05-16T00:41:40.264ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1672024-05-16T00:41:40.264ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1682024-05-16T00:41:40.264ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1692024-05-16T00:41:40.284ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1702024-05-16T00:41:40.300ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1712024-05-16T00:41:40.315ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:355 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
1722024-05-16T00:41:40.315ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1732024-05-16T00:41:40.315ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:367 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
1742024-05-16T00:41:40.315ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1752024-05-16T00:41:40.318ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 103.881855ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "44ca768b-a9d5-4484-a5d8-4e44b351a5a0", "content-length": "124", "date": "Thu, 16 May 2024 00:41:39 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "44ca768b-a9d5-4484-a5d8-4e44b351a5a0" } file = clients/ddm-admin-client/src/lib.rs:178
1762024-05-16T00:41:40.329ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_63e463e5-47a1-42e8-8499-7e0d4be1fc32/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1772024-05-16T00:41:40.352ZINFOSledAgent: successfully created encrypted zvol: name="oxi_63e463e5-47a1-42e8-8499-7e0d4be1fc32/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-05-16T00:41:40.352ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_63e463e5-47a1-42e8-8499-7e0d4be1fc32/swap" file = sled-agent/src/swap_device.rs:96
1792024-05-16T00:41:40.358ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:382 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
1802024-05-16T00:41:40.358ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1812024-05-16T00:41:40.358ZINFOSledAgent (BackingFs): Ensuring dataset oxi_63e463e5-47a1-42e8-8499-7e0d4be1fc32/backing/fmd file = sled-agent/src/backing_fs.rs:136
1822024-05-16T00:41:40.423ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1832024-05-16T00:41:40.426ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 163.912699ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e622b466-9c3e-435d-8755-4700d5a24f7f", "content-length": "124", "date": "Thu, 16 May 2024 00:41:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e622b466-9c3e-435d-8755-4700d5a24f7f" } file = clients/ddm-admin-client/src/lib.rs:178
1842024-05-16T00:41:40.432ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1852024-05-16T00:41:40.591ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1862024-05-16T00:41:40.592ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 130.339871ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c481404c-c719-446c-8f4e-a6dc0dca90ed", "content-length": "124", "date": "Thu, 16 May 2024 00:41:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c481404c-c719-446c-8f4e-a6dc0dca90ed" } file = clients/ddm-admin-client/src/lib.rs:178
1872024-05-16T00:41:40.651ZINFOSledAgent (BackingFs): Mounting oxi_63e463e5-47a1-42e8-8499-7e0d4be1fc32/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1882024-05-16T00:41:40.664ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1892024-05-16T00:41:40.664ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1902024-05-16T00:41:40.664ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1912024-05-16T00:41:40.664ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1922024-05-16T00:41:40.724ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1932024-05-16T00:41:40.724ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 241.397968ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "97a082f0-e9d3-4aff-9775-ce3ab2a9cc5a", "content-length": "124", "date": "Thu, 16 May 2024 00:41:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "97a082f0-e9d3-4aff-9775-ce3ab2a9cc5a" } file = clients/ddm-admin-client/src/lib.rs:178
1942024-05-16T00:41:40.967ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1952024-05-16T00:41:40.968ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 181.976778ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2161d24b-bcc3-4742-8b0e-76dc192a0d31", "content-length": "124", "date": "Thu, 16 May 2024 00:41:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2161d24b-bcc3-4742-8b0e-76dc192a0d31" } file = clients/ddm-admin-client/src/lib.rs:178
1962024-05-16T00:41:41.151ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1972024-05-16T00:41:41.151ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 239.432896ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b1a17385-7e94-459d-b048-aac318e94198", "content-length": "124", "date": "Thu, 16 May 2024 00:41:40 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b1a17385-7e94-459d-b048-aac318e94198" } file = clients/ddm-admin-client/src/lib.rs:178
1982024-05-16T00:41:41.387ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
1992024-05-16T00:41:41.388ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:37133 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2002024-05-16T00:41:41.388ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2012024-05-16T00:41:41.388ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:37133 file = oximeter/producer/src/lib.rs:276 interval = 30s producer_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2022024-05-16T00:41:41.389ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 315.917643ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2032024-05-16T00:41:41.391ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
2042024-05-16T00:41:41.436ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2052024-05-16T00:41:41.436ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2062024-05-16T00:41:41.436ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:993 underlay_address = fd00:1122:3344:101::1
2072024-05-16T00:41:41.436ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2082024-05-16T00:41:41.437ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:12345
2092024-05-16T00:41:41.437ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
2102024-05-16T00:41:41.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2112024-05-16T00:41:41.437ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2122024-05-16T00:41:41.438ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2132024-05-16T00:41:41.438ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2142024-05-16T00:41:41.438ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV1 { routes: [RouteConfig { destination: V4(Ipv4Network { addr: 0.0.0.0, prefix: 0 }), nexthop: 10.151.2.100, vlan_id: None }], addresses: [V4(Ipv4Network { addr: 10.151.2.174, prefix: 24 })], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2152024-05-16T00:41:41.438ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3617
2162024-05-16T00:41:41.438ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:41509
2172024-05-16T00:41:41.438ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2182024-05-16T00:41:41.438ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2192024-05-16T00:41:41.621ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2202024-05-16T00:41:41.621ZINFOSledAgent (RSS): No ledger in /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2212024-05-16T00:41:41.621ZINFOSledAgent (RSS): No ledger in /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2222024-05-16T00:41:41.621ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2232024-05-16T00:41:41.621ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2242024-05-16T00:41:41.626ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2252024-05-16T00:41:41.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42791
2262024-05-16T00:41:41.653ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2272024-05-16T00:41:41.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42791 req_id = b21438a5-498e-4696-b248-c0dc7059dd1c response_code = 200 uri = /inventory
2282024-05-16T00:41:41.682ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53579
2292024-05-16T00:41:41.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53579 req_id = 81c322bf-81cd-46ee-acb4-b370ac22f2c2 response_code = 200 uri = /sled-role
2302024-05-16T00:41:41.682ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2312024-05-16T00:41:41.682ZINFOSledAgent (RSS): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2322024-05-16T00:41:41.683ZINFOSledAgent (RSS): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2332024-05-16T00:41:41.683ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:815
2342024-05-16T00:41:41.707ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 294.427405ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2352024-05-16T00:41:41.714ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: f2cc8df4-59c3-4b03-a023-9d5147748bac, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, pool_id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool) }, OmicronPhysicalDiskConfig { id: f51cc98a-8696-47a6-bc39-21630404e4c1, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, pool_id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool) }, OmicronPhysicalDiskConfig { id: 6bc9b850-5383-48ac-830c-7419df313da9, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, pool_id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool) }, OmicronPhysicalDiskConfig { id: e2d2f278-c254-49c4-8a27-be6dfe43a859, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, pool_id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool) }, OmicronPhysicalDiskConfig { id: cb55421b-0225-4f55-86e6-79c8540255e0, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, pool_id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool) }, OmicronPhysicalDiskConfig { id: d68989bb-7e90-4b96-a418-81b44585a396, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, pool_id: a257a7eb-942f-4c01-b851-a8222ad60649 (zpool) }, OmicronPhysicalDiskConfig { id: 996b23ce-89be-4712-9cc6-ac4a0124886f, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, pool_id: 45089a3d-a9b7-44c7-aa98-3f45b63d8292 (zpool) }, OmicronPhysicalDiskConfig { id: 17fa9891-8225-464c-b1fa-bef0bcaf2aaf, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, pool_id: 23cf064d-a4cd-4feb-84b2-17213c849d5e (zpool) }, OmicronPhysicalDiskConfig { id: 031cb4ee-747f-4909-ad93-b6f55a799165, identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, pool_id: 9f55bff5-f174-4d84-8f88-80c856df8730 (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:347 sled_address = [fd00:1122:3344:101::1]:12345
2362024-05-16T00:41:41.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32975
2372024-05-16T00:41:41.715ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, id: f2cc8df4-59c3-4b03-a023-9d5147748bac, pool_id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, id: f51cc98a-8696-47a6-bc39-21630404e4c1, pool_id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, id: 6bc9b850-5383-48ac-830c-7419df313da9, pool_id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, id: e2d2f278-c254-49c4-8a27-be6dfe43a859, pool_id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, id: cb55421b-0225-4f55-86e6-79c8540255e0, pool_id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, id: d68989bb-7e90-4b96-a418-81b44585a396, pool_id: a257a7eb-942f-4c01-b851-a8222ad60649 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, id: 996b23ce-89be-4712-9cc6-ac4a0124886f, pool_id: 45089a3d-a9b7-44c7-aa98-3f45b63d8292 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, id: 17fa9891-8225-464c-b1fa-bef0bcaf2aaf, pool_id: 23cf064d-a4cd-4feb-84b2-17213c849d5e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, id: 031cb4ee-747f-4909-ad93-b6f55a799165, pool_id: 9f55bff5-f174-4d84-8f88-80c856df8730 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:381
2382024-05-16T00:41:41.715ZINFOSledAgent (StorageManager): No ledger in /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2392024-05-16T00:41:41.715ZINFOSledAgent (StorageManager): No ledger in /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2402024-05-16T00:41:41.715ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2412024-05-16T00:41:41.715ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2422024-05-16T00:41:41.715ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
2432024-05-16T00:41:41.715ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2442024-05-16T00:41:41.715ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } path = /scratch/u2_0.vdev
2452024-05-16T00:41:41.815ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:304
2462024-05-16T00:41:41.815ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool)
2472024-05-16T00:41:42.004ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 738.818389ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2482024-05-16T00:41:42.606ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2492024-05-16T00:41:42.781ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.791793345s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2502024-05-16T00:41:42.791ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }
2512024-05-16T00:41:42.976ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
2522024-05-16T00:41:42.977ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
2532024-05-16T00:41:42.977ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
2542024-05-16T00:41:42.977ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
2552024-05-16T00:41:42.977ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2562024-05-16T00:41:42.977ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2572024-05-16T00:41:42.977ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2582024-05-16T00:41:43.517ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2592024-05-16T00:41:43.708ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2602024-05-16T00:41:43.899ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2612024-05-16T00:41:43.899ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2622024-05-16T00:41:44.117ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_aee2f8e5-ad05-48a0-89c1-d42f21fddf5a/crypt/zone file = sled-storage/src/dataset.rs:395
2632024-05-16T00:41:44.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 64.164457ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2642024-05-16T00:41:44.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 74.578826ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2652024-05-16T00:41:45.430ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2662024-05-16T00:41:45.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 298.67117ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2672024-05-16T00:41:45.615ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.884728317s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2682024-05-16T00:41:45.615ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2692024-05-16T00:41:46.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 514.6351ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2702024-05-16T00:41:46.543ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2712024-05-16T00:41:47.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.050138396s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2722024-05-16T00:41:47.020ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_aee2f8e5-ad05-48a0-89c1-d42f21fddf5a file = sled-storage/src/dataset.rs:480
2732024-05-16T00:41:47.247ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
2742024-05-16T00:41:47.247ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
2752024-05-16T00:41:47.247ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
2762024-05-16T00:41:47.247ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2772024-05-16T00:41:47.247ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } path = /scratch/u2_1.vdev
2782024-05-16T00:41:47.467ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:304
2792024-05-16T00:41:47.467ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool)
2802024-05-16T00:41:48.627ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }
2812024-05-16T00:41:48.857ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
2822024-05-16T00:41:48.857ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
2832024-05-16T00:41:48.857ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
2842024-05-16T00:41:48.857ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
2852024-05-16T00:41:48.857ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-05-16T00:41:48.858ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-05-16T00:41:48.858ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2882024-05-16T00:41:49.357ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2892024-05-16T00:41:49.357ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2902024-05-16T00:41:50.304ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-05-16T00:41:50.796ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2922024-05-16T00:41:50.796ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.710952127s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2932024-05-16T00:41:50.796ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2ca53e61-8a62-423d-bd09-0f828836f86b/crypt/zone file = sled-storage/src/dataset.rs:395
2942024-05-16T00:41:51.265ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2952024-05-16T00:41:51.720ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2962024-05-16T00:41:51.800ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
2972024-05-16T00:41:51.831ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2ca53e61-8a62-423d-bd09-0f828836f86b file = sled-storage/src/dataset.rs:480
2982024-05-16T00:41:51.839ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
2992024-05-16T00:41:51.839ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3002024-05-16T00:41:51.839ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3012024-05-16T00:41:51.839ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3022024-05-16T00:41:51.839ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } path = /scratch/u2_2.vdev
3032024-05-16T00:41:51.849ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:304
3042024-05-16T00:41:51.849ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool)
3052024-05-16T00:41:51.941ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }
3062024-05-16T00:41:51.949ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3072024-05-16T00:41:51.949ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3082024-05-16T00:41:51.949ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3092024-05-16T00:41:51.949ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3102024-05-16T00:41:51.949ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-05-16T00:41:51.949ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-05-16T00:41:51.949ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3132024-05-16T00:41:51.986ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-05-16T00:41:51.994ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81/crypt/zone file = sled-storage/src/dataset.rs:395
3152024-05-16T00:41:52.117ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 file = sled-storage/src/dataset.rs:480
3162024-05-16T00:41:52.125ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3172024-05-16T00:41:52.125ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3182024-05-16T00:41:52.125ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3192024-05-16T00:41:52.125ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3202024-05-16T00:41:52.125ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } path = /scratch/u2_3.vdev
3212024-05-16T00:41:52.134ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:304
3222024-05-16T00:41:52.134ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool)
3232024-05-16T00:41:52.231ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External }
3242024-05-16T00:41:52.239ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3252024-05-16T00:41:52.239ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3262024-05-16T00:41:52.239ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3272024-05-16T00:41:52.239ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3282024-05-16T00:41:52.239ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-05-16T00:41:52.239ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-05-16T00:41:52.239ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3312024-05-16T00:41:52.275ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-05-16T00:41:52.283ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e4892d21-b561-4f79-8b36-35f2ad012b54/crypt/zone file = sled-storage/src/dataset.rs:395
3332024-05-16T00:41:52.404ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e4892d21-b561-4f79-8b36-35f2ad012b54 file = sled-storage/src/dataset.rs:480
3342024-05-16T00:41:52.412ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3352024-05-16T00:41:52.412ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3362024-05-16T00:41:52.412ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3372024-05-16T00:41:52.413ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3382024-05-16T00:41:52.413ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } path = /scratch/u2_4.vdev
3392024-05-16T00:41:52.422ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:304
3402024-05-16T00:41:52.422ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool)
3412024-05-16T00:41:52.512ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External }
3422024-05-16T00:41:52.519ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3432024-05-16T00:41:52.520ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3442024-05-16T00:41:52.520ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3452024-05-16T00:41:52.520ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3462024-05-16T00:41:52.520ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-05-16T00:41:52.520ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-05-16T00:41:52.520ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3492024-05-16T00:41:52.556ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-05-16T00:41:52.564ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_76f4c53b-96f2-4a50-a841-163cf47f5db0/crypt/zone file = sled-storage/src/dataset.rs:395
3512024-05-16T00:41:52.687ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_76f4c53b-96f2-4a50-a841-163cf47f5db0 file = sled-storage/src/dataset.rs:480
3522024-05-16T00:41:52.695ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3532024-05-16T00:41:52.695ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3542024-05-16T00:41:52.695ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3552024-05-16T00:41:52.695ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3562024-05-16T00:41:52.695ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } path = /scratch/u2_5.vdev
3572024-05-16T00:41:52.705ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:304
3582024-05-16T00:41:52.705ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = a257a7eb-942f-4c01-b851-a8222ad60649 (zpool)
3592024-05-16T00:41:52.796ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: a257a7eb-942f-4c01-b851-a8222ad60649 (zpool), kind: External }
3602024-05-16T00:41:52.804ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3612024-05-16T00:41:52.804ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3622024-05-16T00:41:52.804ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3632024-05-16T00:41:52.804ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3642024-05-16T00:41:52.804ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-05-16T00:41:52.804ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-05-16T00:41:52.804ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3672024-05-16T00:41:52.840ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3682024-05-16T00:41:52.844ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
3692024-05-16T00:41:52.848ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a257a7eb-942f-4c01-b851-a8222ad60649/crypt/zone file = sled-storage/src/dataset.rs:395
3702024-05-16T00:41:52.971ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a257a7eb-942f-4c01-b851-a8222ad60649 file = sled-storage/src/dataset.rs:480
3712024-05-16T00:41:52.980ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3722024-05-16T00:41:52.980ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3732024-05-16T00:41:52.980ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3742024-05-16T00:41:52.980ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3752024-05-16T00:41:52.980ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } path = /scratch/u2_6.vdev
3762024-05-16T00:41:52.989ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:304
3772024-05-16T00:41:52.989ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 45089a3d-a9b7-44c7-aa98-3f45b63d8292 (zpool)
3782024-05-16T00:41:53.082ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 45089a3d-a9b7-44c7-aa98-3f45b63d8292 (zpool), kind: External }
3792024-05-16T00:41:53.090ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
3802024-05-16T00:41:53.090ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3812024-05-16T00:41:53.090ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3822024-05-16T00:41:53.090ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3832024-05-16T00:41:53.090ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-05-16T00:41:53.090ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-05-16T00:41:53.090ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3862024-05-16T00:41:53.128ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872024-05-16T00:41:53.136ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_45089a3d-a9b7-44c7-aa98-3f45b63d8292/crypt/zone file = sled-storage/src/dataset.rs:395
3882024-05-16T00:41:53.180ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2303
3892024-05-16T00:41:53.267ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
3902024-05-16T00:41:53.269ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_45089a3d-a9b7-44c7-aa98-3f45b63d8292 file = sled-storage/src/dataset.rs:480
3912024-05-16T00:41:53.277ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
3922024-05-16T00:41:53.277ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
3932024-05-16T00:41:53.277ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
3942024-05-16T00:41:53.277ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3952024-05-16T00:41:53.277ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } path = /scratch/u2_7.vdev
3962024-05-16T00:41:53.287ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:304
3972024-05-16T00:41:53.287ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 23cf064d-a4cd-4feb-84b2-17213c849d5e (zpool)
3982024-05-16T00:41:53.379ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 23cf064d-a4cd-4feb-84b2-17213c849d5e (zpool), kind: External }
3992024-05-16T00:41:53.386ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
4002024-05-16T00:41:53.386ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
4012024-05-16T00:41:53.386ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
4022024-05-16T00:41:53.386ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
4032024-05-16T00:41:53.387ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-05-16T00:41:53.387ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052024-05-16T00:41:53.387ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4062024-05-16T00:41:53.422ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-05-16T00:41:53.430ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crypt/zone file = sled-storage/src/dataset.rs:395
4082024-05-16T00:41:53.552ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e file = sled-storage/src/dataset.rs:480
4092024-05-16T00:41:53.560ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
4102024-05-16T00:41:53.560ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
4112024-05-16T00:41:53.560ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:379
4122024-05-16T00:41:53.560ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
4132024-05-16T00:41:53.560ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:112 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } path = /scratch/u2_8.vdev
4142024-05-16T00:41:53.569ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:304
4152024-05-16T00:41:53.569ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 9f55bff5-f174-4d84-8f88-80c856df8730 (zpool)
4162024-05-16T00:41:53.662ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 9f55bff5-f174-4d84-8f88-80c856df8730 (zpool), kind: External }
4172024-05-16T00:41:53.670ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/dataset.rs:332
4182024-05-16T00:41:53.670ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:334
4192024-05-16T00:41:53.670ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:338
4202024-05-16T00:41:53.670ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } epoch = 0 file = sled-storage/src/dataset.rs:340
4212024-05-16T00:41:53.670ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-05-16T00:41:53.670ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-05-16T00:41:53.670ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4242024-05-16T00:41:53.706ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-05-16T00:41:53.714ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9f55bff5-f174-4d84-8f88-80c856df8730/crypt/zone file = sled-storage/src/dataset.rs:395
4262024-05-16T00:41:53.834ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9f55bff5-f174-4d84-8f88-80c856df8730 file = sled-storage/src/dataset.rs:480
4272024-05-16T00:41:53.841ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:477
4282024-05-16T00:41:53.841ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" } file = sled-storage/src/resources.rs:394
4292024-05-16T00:41:53.841ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4302024-05-16T00:41:53.842ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 63e463e5-47a1-42e8-8499-7e0d4be1fc32 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: 93a5c4e6-bb36-444e-b14f-9a0c92e047b4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: a257a7eb-942f-4c01-b851-a8222ad60649 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: 45089a3d-a9b7-44c7-aa98-3f45b63d8292 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: 23cf064d-a4cd-4feb-84b2-17213c849d5e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: 9f55bff5-f174-4d84-8f88-80c856df8730 (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4312024-05-16T00:41:53.842ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
4322024-05-16T00:41:53.842ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
4332024-05-16T00:41:53.842ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342024-05-16T00:41:53.842ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 12127584 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:32975 req_id = a40b68e6-3830-4bc4-97fc-fc24a00b9ffa response_code = 200 uri = /omicron-physical-disks
4352024-05-16T00:41:53.846ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
4362024-05-16T00:41:53.873ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
4372024-05-16T00:41:53.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37944
4382024-05-16T00:41:53.873ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4392024-05-16T00:41:53.873ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: InternalDns }, responder: ... }
4402024-05-16T00:41:53.925ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4412024-05-16T00:41:53.926ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: InternalDns }, responder: ... }
4422024-05-16T00:41:53.975ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4432024-05-16T00:41:53.975ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4442024-05-16T00:41:54.024ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4452024-05-16T00:41:54.024ZINFOSledAgent (ServiceManager): No ledger in /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/omicron-zones.json file = common/src/ledger.rs:188
4462024-05-16T00:41:54.024ZINFOSledAgent (ServiceManager): No ledger in /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/omicron-zones.json file = common/src/ledger.rs:188
4472024-05-16T00:41:54.024ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4482024-05-16T00:41:54.068ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4492024-05-16T00:41:54.068ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4502024-05-16T00:41:54.068ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4512024-05-16T00:41:54.119ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79 file = illumos-utils/src/zone.rs:315
4522024-05-16T00:41:54.123ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6 file = illumos-utils/src/zone.rs:315
4532024-05-16T00:41:54.127ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec file = illumos-utils/src/zone.rs:315
4542024-05-16T00:41:54.139ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79 file = illumos-utils/src/zone.rs:354
4552024-05-16T00:41:54.145ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6 file = illumos-utils/src/zone.rs:354
4562024-05-16T00:41:54.148ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec file = illumos-utils/src/zone.rs:354
4572024-05-16T00:41:54.847ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ebcdcaed-e48b-4070-ab17-779f5ea072cb): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
4582024-05-16T00:41:55.672ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4592024-05-16T00:41:55.672ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4602024-05-16T00:41:55.672ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
4612024-05-16T00:41:56.154ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4622024-05-16T00:41:56.632ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4632024-05-16T00:41:56.632ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4642024-05-16T00:41:56.632ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4652024-05-16T00:41:56.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec") failed: Property not found. retry in 69.794416ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
4662024-05-16T00:41:56.640ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
4672024-05-16T00:41:56.644ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
4682024-05-16T00:41:56.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec") failed: Property not found. retry in 74.204119ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
4692024-05-16T00:41:56.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79") failed: Property not found. retry in 36.262405ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
4702024-05-16T00:41:56.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6") failed: Property not found. retry in 35.253755ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
4712024-05-16T00:41:56.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec") failed: Property not found. retry in 206.20086ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
4722024-05-16T00:41:56.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79") failed: Property not found. retry in 129.95512ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
4732024-05-16T00:41:56.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6") failed: Property not found. retry in 131.374531ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
4742024-05-16T00:41:56.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79") failed: Property not found. retry in 190.027054ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
4752024-05-16T00:41:57.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6") failed: Property not found. retry in 267.218206ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
4762024-05-16T00:41:57.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec") failed: Property not found. retry in 347.628403ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
4772024-05-16T00:41:57.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79") failed: Property not found. retry in 398.661704ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
4782024-05-16T00:41:57.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6") failed: Property not found. retry in 319.993273ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
4792024-05-16T00:41:57.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec") failed: Property not found. retry in 1.074832332s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
4802024-05-16T00:41:57.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79") failed: Property not found. retry in 889.352795ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
4812024-05-16T00:41:57.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6") failed: Property not found. retry in 787.441468ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
4822024-05-16T00:41:58.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6") failed: Property not found. retry in 1.160272726s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
4832024-05-16T00:41:58.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec") failed: Property not found. retry in 1.303481404s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
4842024-05-16T00:41:58.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79") failed: Property not found. retry in 785.482964ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
4852024-05-16T00:41:59.235ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:a02a::2 exists in switch zone file = sled-agent/src/services.rs:2320
4862024-05-16T00:41:59.235ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4872024-05-16T00:41:59.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79") failed: Property not found. retry in 913.11578ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
4882024-05-16T00:41:59.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6") failed: Property not found. retry in 1.170315898s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
4892024-05-16T00:41:59.779ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fee6:5ec3 file = sled-agent/src/services.rs:2327
4902024-05-16T00:41:59.786ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2388
4912024-05-16T00:41:59.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec") failed: Property not found. retry in 1.165362763s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
4922024-05-16T00:41:59.903ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2573
4932024-05-16T00:42:00.144ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2737
4942024-05-16T00:42:00.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79") failed: Property not found. retry in 834.01647ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
4952024-05-16T00:42:00.331ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2452
4962024-05-16T00:42:00.637ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2487
4972024-05-16T00:42:00.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6") failed: Property not found. retry in 1.194913733s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
4982024-05-16T00:42:00.857ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2787
4992024-05-16T00:42:00.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec") failed: Property not found. retry in 641.44574ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
5002024-05-16T00:42:01.038ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2814
5012024-05-16T00:42:01.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79") failed: Property not found. retry in 1.101772263s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
5022024-05-16T00:42:01.255ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2681
5032024-05-16T00:42:01.460ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2481
5042024-05-16T00:42:01.470ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3873 new = [fd00:1122:3344:101::2, ::1] old = [::1]
5052024-05-16T00:42:01.470ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3889
5062024-05-16T00:42:01.470ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
5072024-05-16T00:42:02.027ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3897
5082024-05-16T00:42:02.034ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3953
5092024-05-16T00:42:02.181ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4015
5102024-05-16T00:42:02.198ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_be423f23-fd69-4b81-8a1e-bf9c875e02ec
5112024-05-16T00:42:02.198ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_28e2255e-9cdb-495f-97fa-d87100d3cc79
5122024-05-16T00:42:02.199ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_403c1562-69cb-4d5b-9ec3-a628607b35b6
5132024-05-16T00:42:02.199ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5142024-05-16T00:42:02.199ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5152024-05-16T00:42:02.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8326216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37944 req_id = 091f7477-6395-4666-9a6f-9273145b4f29 response_code = 204 uri = /omicron-zones
5162024-05-16T00:42:02.201ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:548
5172024-05-16T00:42:02.283ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3996 rack_subnet = fd00:1122:3344::
5182024-05-16T00:42:02.304ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4043
5192024-05-16T00:42:02.373ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 61.61923ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:568
5202024-05-16T00:42:02.398ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4070
5212024-05-16T00:42:02.453ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:548
5222024-05-16T00:42:02.523ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:365
5232024-05-16T00:42:02.569ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:548
5242024-05-16T00:42:02.584ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:413
5252024-05-16T00:42:02.638ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:651
5262024-05-16T00:42:02.639ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:689
5272024-05-16T00:42:02.639ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:692 uptime = 2
5282024-05-16T00:42:02.639ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:435
5292024-05-16T00:42:02.672ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:584
5302024-05-16T00:42:02.672ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5312024-05-16T00:42:02.718ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5322024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
5332024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-M2" }
5342024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
5352024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2" }
5362024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }
5372024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-M2" }
5382024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
5392024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2" }
5402024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
5412024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2" }
5422024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
5432024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2" }
5442024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
5452024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2" }
5462024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
5472024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2" }
5482024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
5492024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2" }
5502024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
5512024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2" }
5522024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
5532024-05-16T00:42:02.718ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2" }
5542024-05-16T00:42:02.718ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5552024-05-16T00:42:02.721ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5562024-05-16T00:42:02.721ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5572024-05-16T00:42:02.750ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ffec8475-767a-40dc-a0c4-16eff0c7741a, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 225171f1-492a-4068-90ae-9b302fc7e6f9, kind: Service { id: ffec8475-767a-40dc-a0c4-16eff0c7741a }, name: Name("ntp-ffec8475-767a-40dc-a0c4-16eff0c7741a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 18])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
5582024-05-16T00:42:02.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56468
5592024-05-16T00:42:02.750ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5602024-05-16T00:42:02.750ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: InternalDns }, responder: ... }
5612024-05-16T00:42:02.771ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5622024-05-16T00:42:02.771ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: InternalDns }, responder: ... }
5632024-05-16T00:42:02.789ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5642024-05-16T00:42:02.789ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5652024-05-16T00:42:02.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5662024-05-16T00:42:02.808ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/omicron-zones.json file = common/src/ledger.rs:177
5672024-05-16T00:42:02.808ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/omicron-zones.json file = common/src/ledger.rs:177
5682024-05-16T00:42:02.808ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5692024-05-16T00:42:02.819ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5702024-05-16T00:42:02.852ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5712024-05-16T00:42:02.852ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5722024-05-16T00:42:02.852ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5732024-05-16T00:42:02.896ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 235, 18]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5742024-05-16T00:42:02.896ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = ntp
5752024-05-16T00:42:02.897ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
5762024-05-16T00:42:02.897ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
5772024-05-16T00:42:02.898ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
5782024-05-16T00:42:02.900ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5792024-05-16T00:42:02.923ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a file = illumos-utils/src/zone.rs:315
5802024-05-16T00:42:02.942ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a file = illumos-utils/src/zone.rs:354
5812024-05-16T00:42:03.569ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5822024-05-16T00:42:03.569ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5832024-05-16T00:42:03.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a") failed: Property not found. retry in 51.152196ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5842024-05-16T00:42:03.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a") failed: Property not found. retry in 135.650209ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5852024-05-16T00:42:03.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a") failed: Property not found. retry in 159.380139ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5862024-05-16T00:42:04.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a") failed: Property not found. retry in 336.928274ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5872024-05-16T00:42:04.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a") failed: Property not found. retry in 643.45405ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5882024-05-16T00:42:05.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a") failed: Property not found. retry in 1.0493393s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5892024-05-16T00:42:05.900ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45203
5902024-05-16T00:42:05.900ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45203 req_id = 09ee0dec-bc12-467d-b593-8edeb193b819 response_code = 200 uri = /baseboard
5912024-05-16T00:42:06.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a") failed: Property not found. retry in 708.46815ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5922024-05-16T00:42:06.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a") failed: Property not found. retry in 1.073858189s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5932024-05-16T00:42:07.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a") failed: Property not found. retry in 1.477423328s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5942024-05-16T00:42:09.472ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a
5952024-05-16T00:42:09.472ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5962024-05-16T00:42:09.473ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5972024-05-16T00:42:09.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 6722581 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56468 req_id = 419f3adc-a0fc-41d7-94e0-8a6cc086d095 response_code = 204 uri = /omicron-zones
5982024-05-16T00:42:09.475ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:625
5992024-05-16T00:42:09.506ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6002024-05-16T00:42:09.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46740
6012024-05-16T00:42:09.514ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6022024-05-16T00:42:09.515ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 8743 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46740 req_id = 87fb3f5d-0e18-4911-a61c-94ded1988458 response_code = 500 uri = /timesync
6032024-05-16T00:42:09.517ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6042024-05-16T00:42:09.650ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6052024-05-16T00:42:09.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59668
6062024-05-16T00:42:13.657ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6072024-05-16T00:42:13.657ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 4007336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59668 req_id = e2b5555c-5ff3-4df8-9954-4c423db63d45 response_code = 500 uri = /timesync
6082024-05-16T00:42:13.661ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6092024-05-16T00:42:13.818ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6102024-05-16T00:42:13.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43267
6112024-05-16T00:42:13.828ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6122024-05-16T00:42:13.828ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 9655 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43267 req_id = 40197313-0eab-44b0-b87a-51b51854f79b response_code = 500 uri = /timesync
6132024-05-16T00:42:13.829ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6142024-05-16T00:42:13.995ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6152024-05-16T00:42:13.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51642
6162024-05-16T00:42:18.003ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_ffec8475-767a-40dc-a0c4-16eff0c7741a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6172024-05-16T00:42:18.003ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 4008594 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51642 req_id = 4e71d4d3-faa8-4ab5-8009-83e2d1df21ea response_code = 500 uri = /timesync
6182024-05-16T00:42:18.006ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 195.844677ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
6192024-05-16T00:42:18.007ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6202024-05-16T00:42:18.278ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6212024-05-16T00:42:18.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36423
6222024-05-16T00:42:18.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8537 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36423 req_id = 65234cb8-f468-4d92-841f-c7dcfa43d121 response_code = 200 uri = /timesync
6232024-05-16T00:42:18.290ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6242024-05-16T00:42:18.290ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6252024-05-16T00:42:18.571ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6262024-05-16T00:42:18.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64003
6272024-05-16T00:42:18.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8072 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64003 req_id = a1ddd0e3-5fd6-4205-8a43-e1bda25ebe29 response_code = 200 uri = /timesync
6282024-05-16T00:42:18.583ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6292024-05-16T00:42:18.583ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6302024-05-16T00:42:18.796ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6312024-05-16T00:42:18.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59376
6322024-05-16T00:42:18.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 7663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59376 req_id = 5f9dcd58-10f8-4370-b556-c4877a870635 response_code = 200 uri = /timesync
6332024-05-16T00:42:18.807ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6342024-05-16T00:42:18.807ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6352024-05-16T00:42:19.136ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6362024-05-16T00:42:19.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49565
6372024-05-16T00:42:19.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8355 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49565 req_id = 787424b3-1438-48e4-ab24-a345051594b0 response_code = 200 uri = /timesync
6382024-05-16T00:42:19.148ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6392024-05-16T00:42:19.148ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6402024-05-16T00:42:19.486ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6412024-05-16T00:42:19.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42529
6422024-05-16T00:42:19.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8413 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42529 req_id = 80ae8588-6362-4a0f-b5eb-fb2a8780166f response_code = 200 uri = /timesync
6432024-05-16T00:42:19.497ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6442024-05-16T00:42:19.497ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6452024-05-16T00:42:21.202ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6462024-05-16T00:42:21.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57149
6472024-05-16T00:42:21.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8542 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57149 req_id = e9f88b04-49af-421e-a9d1-98c2b427ad1e response_code = 200 uri = /timesync
6482024-05-16T00:42:21.213ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6492024-05-16T00:42:21.213ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6502024-05-16T00:42:21.887ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6512024-05-16T00:42:21.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33720
6522024-05-16T00:42:21.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 7400 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33720 req_id = 9bc89550-8977-4516-8ff3-23efa69fb6e5 response_code = 200 uri = /timesync
6532024-05-16T00:42:21.898ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6542024-05-16T00:42:21.898ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6552024-05-16T00:42:22.385ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6562024-05-16T00:42:22.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54437
6572024-05-16T00:42:22.393ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 7514 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54437 req_id = cf05ad9d-4850-42bf-975b-89f67c80ceba response_code = 200 uri = /timesync
6582024-05-16T00:42:22.394ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6592024-05-16T00:42:22.394ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6602024-05-16T00:42:23.149ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6612024-05-16T00:42:23.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46273
6622024-05-16T00:42:23.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46273 req_id = 5abd0361-9301-4173-a6b8-c9bdb1140c0d response_code = 200 uri = /timesync
6632024-05-16T00:42:23.160ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6642024-05-16T00:42:23.160ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6652024-05-16T00:42:23.741ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6662024-05-16T00:42:23.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37994
6672024-05-16T00:42:23.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37994 req_id = a2b614ec-8525-4399-86af-adc42d30103a response_code = 200 uri = /timesync
6682024-05-16T00:42:23.751ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6692024-05-16T00:42:23.751ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6702024-05-16T00:42:25.240ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6712024-05-16T00:42:25.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44620
6722024-05-16T00:42:25.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44620 req_id = 137af5a1-ce64-473d-a60c-4b98469f6bef response_code = 200 uri = /timesync
6732024-05-16T00:42:25.251ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6742024-05-16T00:42:25.251ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6752024-05-16T00:42:25.926ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6762024-05-16T00:42:25.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48830
6772024-05-16T00:42:25.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48830 req_id = 85c8353d-b312-4521-87c2-500a95a4b5ce response_code = 200 uri = /timesync
6782024-05-16T00:42:25.936ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6792024-05-16T00:42:25.936ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6802024-05-16T00:42:27.417ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6812024-05-16T00:42:27.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36587
6822024-05-16T00:42:27.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8001 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36587 req_id = 9e0ce208-ed7f-4b7c-8a10-7112635947d7 response_code = 200 uri = /timesync
6832024-05-16T00:42:27.427ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6842024-05-16T00:42:27.427ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6852024-05-16T00:42:29.055ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6862024-05-16T00:42:29.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38132
6872024-05-16T00:42:29.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8666 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38132 req_id = 0aadcc86-e4eb-4788-b485-bdc2ee4982aa response_code = 200 uri = /timesync
6882024-05-16T00:42:29.067ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6892024-05-16T00:42:29.067ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6902024-05-16T00:42:31.568ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6912024-05-16T00:42:31.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35148
6922024-05-16T00:42:31.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8700 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35148 req_id = e57b6d5d-5ab2-4b3f-9d66-acbe4adef545 response_code = 200 uri = /timesync
6932024-05-16T00:42:31.580ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6942024-05-16T00:42:31.580ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6952024-05-16T00:42:34.212ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 468.664249ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
6962024-05-16T00:42:34.523ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6972024-05-16T00:42:34.523ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54296
6982024-05-16T00:42:34.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54296 req_id = 490daca2-665d-4abf-8a55-86070178bc71 response_code = 200 uri = /timesync
6992024-05-16T00:42:34.533ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7002024-05-16T00:42:34.533ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7012024-05-16T00:42:36.909ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53563
7022024-05-16T00:42:36.909ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53563 req_id = d240ca89-b030-4007-97e5-66f68f82f30c response_code = 200 uri = /baseboard
7032024-05-16T00:42:38.934ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7042024-05-16T00:42:38.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48685
7052024-05-16T00:42:38.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48685 req_id = d1c9e3eb-c662-4e70-98dc-a086e90b513e response_code = 200 uri = /timesync
7062024-05-16T00:42:38.945ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7072024-05-16T00:42:38.945ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7082024-05-16T00:42:41.421ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7092024-05-16T00:42:41.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37607
7102024-05-16T00:42:41.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8644 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37607 req_id = a417c54b-b1d0-4ab1-abfa-728865b068b4 response_code = 200 uri = /timesync
7112024-05-16T00:42:41.432ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7122024-05-16T00:42:41.432ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7132024-05-16T00:42:43.964ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7142024-05-16T00:42:43.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65015
7152024-05-16T00:42:43.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8973 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65015 req_id = 7ad82e80-cfc5-4dba-aa05-1646d78e2dbe response_code = 200 uri = /timesync
7162024-05-16T00:42:43.976ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7172024-05-16T00:42:43.976ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7182024-05-16T00:42:49.718ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.19340684s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
7192024-05-16T00:42:50.568ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7202024-05-16T00:42:50.568ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57476
7212024-05-16T00:42:50.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8984 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57476 req_id = 19d5ca22-188b-4e9c-9a5d-0e01b34d54ff response_code = 200 uri = /timesync
7222024-05-16T00:42:50.579ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7232024-05-16T00:42:50.579ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7242024-05-16T00:42:59.703ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7252024-05-16T00:42:59.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37011
7262024-05-16T00:42:59.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8457 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37011 req_id = e21e3b55-f924-493b-a130-259bdcf668d6 response_code = 200 uri = /timesync
7272024-05-16T00:42:59.714ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7282024-05-16T00:42:59.714ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7292024-05-16T00:43:05.946ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.231063056s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
7302024-05-16T00:43:06.942ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55606
7312024-05-16T00:43:06.942ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55606 req_id = 1c59dd3e-4e0d-4dfd-ac64-458df0d2492d response_code = 200 uri = /baseboard
7322024-05-16T00:43:08.959ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7332024-05-16T00:43:08.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38750
7342024-05-16T00:43:08.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 9259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38750 req_id = 239fc16e-c212-4099-9ea0-54b8b4da4502 response_code = 200 uri = /timesync
7352024-05-16T00:43:08.972ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7362024-05-16T00:43:08.972ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7372024-05-16T00:43:14.995ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7382024-05-16T00:43:14.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64913
7392024-05-16T00:43:15.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 9058 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64913 req_id = d35df48c-476d-46c9-b087-6971d13210f4 response_code = 200 uri = /timesync
7402024-05-16T00:43:15.007ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7412024-05-16T00:43:15.007ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7422024-05-16T00:43:21.028ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7432024-05-16T00:43:21.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62676
7442024-05-16T00:43:21.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8632 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62676 req_id = f05d594a-52eb-4034-afc2-2da08ebe1e2a response_code = 200 uri = /timesync
7452024-05-16T00:43:21.039ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7462024-05-16T00:43:21.039ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7472024-05-16T00:43:23.211ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.569967751s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
7482024-05-16T00:43:32.329ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7492024-05-16T00:43:32.329ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63450
7502024-05-16T00:43:32.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 9341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63450 req_id = 52562d05-d3a1-4d32-be3f-b3154df89b53 response_code = 200 uri = /timesync
7512024-05-16T00:43:32.341ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7522024-05-16T00:43:32.341ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7532024-05-16T00:43:37.104ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65083
7542024-05-16T00:43:37.105ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 578 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65083 req_id = bcb4e8e8-1c13-43dc-aab7-600517b7602c response_code = 200 uri = /baseboard
7552024-05-16T00:43:40.948ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.15819042s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
7562024-05-16T00:43:41.018ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7572024-05-16T00:43:41.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46251
7582024-05-16T00:43:41.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8666 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46251 req_id = bb33a4c4-0aca-42e7-a0f2-fd6f1c61c759 response_code = 200 uri = /timesync
7592024-05-16T00:43:41.030ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
7602024-05-16T00:43:41.030ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7612024-05-16T00:44:00.096ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.170817399s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
7622024-05-16T00:44:06.055ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7632024-05-16T00:44:06.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61523
7642024-05-16T00:44:06.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 9383 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61523 req_id = 58a70f34-1af3-4241-b7b0-5d145e2ad346 response_code = 200 uri = /timesync
7652024-05-16T00:44:06.068ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1715820224.4322042, correction: -0.227036357 } file = sled-agent/src/rack_setup/service.rs:633
7662024-05-16T00:44:06.068ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7672024-05-16T00:44:07.074ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56132
7682024-05-16T00:44:07.074ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56132 req_id = 71f8be91-a9f9-4380-b33e-6ca3f608e75e response_code = 200 uri = /baseboard
7692024-05-16T00:44:26.230ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 17.295096719s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
7702024-05-16T00:44:31.501ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7712024-05-16T00:44:31.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54718
7722024-05-16T00:44:31.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8919 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54718 req_id = b12ca575-6dc3-4d78-ac5e-031837233250 response_code = 200 uri = /timesync
7732024-05-16T00:44:31.513ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1715820224.4322042, correction: -0.157934234 } file = sled-agent/src/rack_setup/service.rs:633
7742024-05-16T00:44:31.513ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7752024-05-16T00:44:37.026ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48994
7762024-05-16T00:44:37.027ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48994 req_id = 23c3ce0e-717d-456f-8d0c-50dfae94f994 response_code = 200 uri = /baseboard
7772024-05-16T00:44:58.472ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 89.064165387s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
7782024-05-16T00:45:06.976ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41604
7792024-05-16T00:45:06.976ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41604 req_id = 9b8cdaeb-ce0d-4e50-9a54-3116660f977a response_code = 200 uri = /baseboard
7802024-05-16T00:45:14.119ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7812024-05-16T00:45:14.119ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47217
7822024-05-16T00:45:14.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 9187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47217 req_id = b73e9a2d-352a-42e7-961e-3c1c5d3f87ba response_code = 200 uri = /timesync
7832024-05-16T00:45:14.131ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1715820289.0629194, correction: -0.043379966 } file = sled-agent/src/rack_setup/service.rs:633
7842024-05-16T00:45:14.132ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7852024-05-16T00:45:36.943ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63317
7862024-05-16T00:45:36.943ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63317 req_id = e46e1011-5313-43b4-9d2c-b1a0eb03ff48 response_code = 200 uri = /baseboard
7872024-05-16T00:46:00.236ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7882024-05-16T00:46:00.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50078
7892024-05-16T00:46:00.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 20105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50078 req_id = eba069bc-2aa2-404c-86a1-f1da6b749c1f response_code = 200 uri = /timesync
7902024-05-16T00:46:00.259ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1715820354.942686, correction: 0.000677771 } file = sled-agent/src/rack_setup/service.rs:633
7912024-05-16T00:46:00.259ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1216
7922024-05-16T00:46:00.287ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ffec8475-767a-40dc-a0c4-16eff0c7741a, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 225171f1-492a-4068-90ae-9b302fc7e6f9, kind: Service { id: ffec8475-767a-40dc-a0c4-16eff0c7741a }, name: Name("ntp-ffec8475-767a-40dc-a0c4-16eff0c7741a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 18])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: fc80b00d-30b4-43ce-8aff-0aff0c3a62d8, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } } } }, OmicronZoneConfig { id: 2c6c0aa6-9566-444d-ac70-2049e43e6e2d, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External } } } }, OmicronZoneConfig { id: c8a81356-5955-41a7-8084-4412d883857b, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External } } } }, OmicronZoneConfig { id: f9109eb7-707a-48b6-b731-30d76c9dfbfa, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External } } } }, OmicronZoneConfig { id: 396090a1-23c0-490d-82cb-1cdd686a90de, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
7932024-05-16T00:46:00.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38078
7942024-05-16T00:46:00.289ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7952024-05-16T00:46:00.289ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: InternalDns }, responder: ... }
7962024-05-16T00:46:00.311ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7972024-05-16T00:46:00.311ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: InternalDns }, responder: ... }
7982024-05-16T00:46:00.331ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7992024-05-16T00:46:00.331ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8002024-05-16T00:46:00.349ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fc80b00d-30b4-43ce-8aff-0aff0c3a62d8, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8012024-05-16T00:46:00.349ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: fc80b00d-30b4-43ce-8aff-0aff0c3a62d8, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8022024-05-16T00:46:00.403ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2c6c0aa6-9566-444d-ac70-2049e43e6e2d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8032024-05-16T00:46:00.403ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2c6c0aa6-9566-444d-ac70-2049e43e6e2d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8042024-05-16T00:46:00.454ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c8a81356-5955-41a7-8084-4412d883857b, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8052024-05-16T00:46:00.455ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c8a81356-5955-41a7-8084-4412d883857b, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8062024-05-16T00:46:00.507ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f9109eb7-707a-48b6-b731-30d76c9dfbfa, dataset_name: DatasetName { pool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8072024-05-16T00:46:00.507ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: f9109eb7-707a-48b6-b731-30d76c9dfbfa, dataset_name: DatasetName { pool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8082024-05-16T00:46:00.559ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 396090a1-23c0-490d-82cb-1cdd686a90de, dataset_name: DatasetName { pool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8092024-05-16T00:46:00.559ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 396090a1-23c0-490d-82cb-1cdd686a90de, dataset_name: DatasetName { pool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8102024-05-16T00:46:00.611ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8112024-05-16T00:46:00.611ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/omicron-zones.json file = common/src/ledger.rs:177
8122024-05-16T00:46:00.611ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/omicron-zones.json file = common/src/ledger.rs:177
8132024-05-16T00:46:00.611ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8142024-05-16T00:46:00.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8152024-05-16T00:46:00.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8162024-05-16T00:46:00.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8172024-05-16T00:46:00.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8182024-05-16T00:46:00.692ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8192024-05-16T00:46:00.779ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa file = illumos-utils/src/zone.rs:315
8202024-05-16T00:46:00.783ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d file = illumos-utils/src/zone.rs:315
8212024-05-16T00:46:00.787ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8 file = illumos-utils/src/zone.rs:315
8222024-05-16T00:46:00.792ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b file = illumos-utils/src/zone.rs:315
8232024-05-16T00:46:00.796ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de file = illumos-utils/src/zone.rs:315
8242024-05-16T00:46:00.802ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa file = illumos-utils/src/zone.rs:354
8252024-05-16T00:46:00.806ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d file = illumos-utils/src/zone.rs:354
8262024-05-16T00:46:00.810ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8 file = illumos-utils/src/zone.rs:354
8272024-05-16T00:46:00.815ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b file = illumos-utils/src/zone.rs:354
8282024-05-16T00:46:00.819ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de file = illumos-utils/src/zone.rs:354
8292024-05-16T00:46:03.611ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::4"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8302024-05-16T00:46:03.611ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8312024-05-16T00:46:03.619ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::3"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8322024-05-16T00:46:03.619ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8332024-05-16T00:46:03.669ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::7"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8342024-05-16T00:46:03.669ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8352024-05-16T00:46:03.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 39.613843ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8362024-05-16T00:46:03.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 65.19943ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8372024-05-16T00:46:03.766ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::6"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8382024-05-16T00:46:03.766ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::5"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8392024-05-16T00:46:03.766ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8402024-05-16T00:46:03.770ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8412024-05-16T00:46:03.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 68.410206ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8422024-05-16T00:46:03.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 70.662114ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8432024-05-16T00:46:04.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 138.202179ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8442024-05-16T00:46:04.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 156.342883ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8452024-05-16T00:46:04.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 113.739636ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8462024-05-16T00:46:04.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 281.130979ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8472024-05-16T00:46:04.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 42.464511ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8482024-05-16T00:46:04.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 376.826068ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8492024-05-16T00:46:04.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b") failed: Property not found. retry in 53.612384ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8502024-05-16T00:46:04.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 167.950236ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8512024-05-16T00:46:05.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 94.176349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8522024-05-16T00:46:05.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.087258125s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8532024-05-16T00:46:05.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 532.887611ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8542024-05-16T00:46:05.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b") failed: Property not found. retry in 132.882473ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8552024-05-16T00:46:05.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 488.023533ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8562024-05-16T00:46:05.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 145.726001ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8572024-05-16T00:46:06.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 781.177981ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8582024-05-16T00:46:06.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b") failed: Property not found. retry in 198.596294ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8592024-05-16T00:46:06.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 249.325253ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8602024-05-16T00:46:06.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b") failed: Property not found. retry in 542.291318ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8612024-05-16T00:46:06.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.429377852s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8622024-05-16T00:46:06.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 679.141695ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8632024-05-16T00:46:06.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 449.469519ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8642024-05-16T00:46:06.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 1.264773333s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8652024-05-16T00:46:06.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b") failed: Property not found. retry in 884.260517ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8662024-05-16T00:46:06.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 553.372412ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8672024-05-16T00:46:06.975ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37681
8682024-05-16T00:46:06.975ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 73 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37681 req_id = 59e61964-0eaf-4a69-9f92-a1e7ac8ad1e9 response_code = 200 uri = /baseboard
8692024-05-16T00:46:07.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 585.409768ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8702024-05-16T00:46:07.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 1.169752798s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8712024-05-16T00:46:07.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 775.245097ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8722024-05-16T00:46:07.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b") failed: Property not found. retry in 885.897548ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8732024-05-16T00:46:07.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.115188759s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8742024-05-16T00:46:08.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 704.413143ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8752024-05-16T00:46:08.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 1.415691239s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8762024-05-16T00:46:08.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b") failed: Property not found. retry in 1.388995696s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8772024-05-16T00:46:08.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 1.042116073s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8782024-05-16T00:46:08.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 1.383226797s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8792024-05-16T00:46:08.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 577.062915ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8802024-05-16T00:46:09.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.323447877s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8812024-05-16T00:46:09.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 1.317643208s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8822024-05-16T00:46:09.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 838.128023ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8832024-05-16T00:46:10.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b") failed: Property not found. retry in 1.157122056s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8842024-05-16T00:46:10.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 1.31469111s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8852024-05-16T00:46:10.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 629.431707ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8862024-05-16T00:46:10.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.476871828s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8872024-05-16T00:46:11.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de") failed: Property not found. retry in 1.337760875s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
8882024-05-16T00:46:11.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b") failed: Property not found. retry in 1.490102033s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
8892024-05-16T00:46:11.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa") failed: Property not found. retry in 1.107428361s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
8902024-05-16T00:46:11.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8") failed: Property not found. retry in 877.437691ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
8912024-05-16T00:46:12.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.473606133s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8922024-05-16T00:46:13.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 729.181867ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8932024-05-16T00:46:14.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.099778898s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8942024-05-16T00:46:15.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 552.909851ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8952024-05-16T00:46:16.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 597.839871ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8962024-05-16T00:46:16.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.211983611s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8972024-05-16T00:46:18.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 987.108976ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8982024-05-16T00:46:19.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.499972251s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
8992024-05-16T00:46:20.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d") failed: Property not found. retry in 1.121958692s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
9002024-05-16T00:46:21.816ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_f9109eb7-707a-48b6-b731-30d76c9dfbfa
9012024-05-16T00:46:21.816ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d
9022024-05-16T00:46:21.816ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_fc80b00d-30b4-43ce-8aff-0aff0c3a62d8
9032024-05-16T00:46:21.816ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_c8a81356-5955-41a7-8084-4412d883857b
9042024-05-16T00:46:21.816ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_396090a1-23c0-490d-82cb-1cdd686a90de
9052024-05-16T00:46:21.816ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9062024-05-16T00:46:21.817ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9072024-05-16T00:46:21.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 21530618 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38078 req_id = b3f4cf95-c6ef-454f-9352-85b6e2bcff2d response_code = 204 uri = /omicron-zones
9082024-05-16T00:46:21.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49434
9092024-05-16T00:46:21.882ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 29697 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49434 req_id = b9c85668-b036-43de-96cc-7a64fd6b7872 response_code = 500 uri = /cockroachdb
9102024-05-16T00:46:21.882ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b9c85668-b036-43de-96cc-7a64fd6b7872", "content-length": "124", "date": "Thu, 16 May 2024 00:46:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b9c85668-b036-43de-96cc-7a64fd6b7872" } file = sled-agent/src/rack_setup/service.rs:958 retry_after = 142.390558ms
9112024-05-16T00:46:22.053ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 27162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49434 req_id = dd818e18-53e2-4aac-ba5b-acc9311a053e response_code = 500 uri = /cockroachdb
9122024-05-16T00:46:22.053ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dd818e18-53e2-4aac-ba5b-acc9311a053e", "content-length": "124", "date": "Thu, 16 May 2024 00:46:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dd818e18-53e2-4aac-ba5b-acc9311a053e" } file = sled-agent/src/rack_setup/service.rs:958 retry_after = 121.471474ms
9132024-05-16T00:46:22.201ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 26019 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49434 req_id = 86c0e7af-e5c1-452f-a4a9-ad2fa99a85df response_code = 500 uri = /cockroachdb
9142024-05-16T00:46:22.201ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "86c0e7af-e5c1-452f-a4a9-ad2fa99a85df", "content-length": "124", "date": "Thu, 16 May 2024 00:46:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "86c0e7af-e5c1-452f-a4a9-ad2fa99a85df" } file = sled-agent/src/rack_setup/service.rs:958 retry_after = 93.713733ms
9152024-05-16T00:46:22.321ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c6c0aa6-9566-444d-ac70-2049e43e6e2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 24799 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49434 req_id = 606a73b3-68cb-42f1-99b3-d1622c752167 response_code = 500 uri = /cockroachdb
9162024-05-16T00:46:22.322ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "606a73b3-68cb-42f1-99b3-d1622c752167", "content-length": "124", "date": "Thu, 16 May 2024 00:46:21 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "606a73b3-68cb-42f1-99b3-d1622c752167" } file = sled-agent/src/rack_setup/service.rs:958 retry_after = 161.576841ms
9172024-05-16T00:46:22.512ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3437
9182024-05-16T00:46:25.186ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3455
9192024-05-16T00:46:27.176ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3478
9202024-05-16T00:46:27.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 4691025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:49434 req_id = a9c22fad-54a6-4d45-8fe4-2d31a143151b response_code = 204 uri = /cockroachdb
9212024-05-16T00:46:27.211ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: ffec8475-767a-40dc-a0c4-16eff0c7741a, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 225171f1-492a-4068-90ae-9b302fc7e6f9, kind: Service { id: ffec8475-767a-40dc-a0c4-16eff0c7741a }, name: Name("ntp-ffec8475-767a-40dc-a0c4-16eff0c7741a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 235, 18])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: fc80b00d-30b4-43ce-8aff-0aff0c3a62d8, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } } } }, OmicronZoneConfig { id: 2c6c0aa6-9566-444d-ac70-2049e43e6e2d, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External } } } }, OmicronZoneConfig { id: c8a81356-5955-41a7-8084-4412d883857b, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External } } } }, OmicronZoneConfig { id: f9109eb7-707a-48b6-b731-30d76c9dfbfa, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External } } } }, OmicronZoneConfig { id: 396090a1-23c0-490d-82cb-1cdd686a90de, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 55e42f05-d8aa-4cb2-94c1-93db88708faf, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 407bf9eb-4fe8-4336-ba89-2a02d924feb0, kind: Service { id: 55e42f05-d8aa-4cb2-94c1-93db88708faf }, name: Name("external-dns-55e42f05-d8aa-4cb2-94c1-93db88708faf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 67])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: ecc3cc87-d31b-4070-8357-42402a3de4ca, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 4463ba03-6579-42ed-9daf-60d5a2bd4034, kind: Service { id: ecc3cc87-d31b-4070-8357-42402a3de4ca }, name: Name("external-dns-ecc3cc87-d31b-4070-8357-42402a3de4ca"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 109])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: d5d04124-9918-4bce-aa79-2388f6395fc0, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: a9a4da95-41c7-4399-8d08-a7f8775a4ec2, kind: Service { id: d5d04124-9918-4bce-aa79-2388f6395fc0 }, name: Name("nexus-d5d04124-9918-4bce-aa79-2388f6395fc0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 194])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c199aa4c-85c6-4fda-8438-db73e90a5af3, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: ed5b09fd-ac17-4e3a-8880-cb9a1fe84fd7, kind: Service { id: c199aa4c-85c6-4fda-8438-db73e90a5af3 }, name: Name("nexus-c199aa4c-85c6-4fda-8438-db73e90a5af3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 211])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4d1bdec4-0663-468f-bb89-b96fff034657, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 38e6570f-f2b9-4258-8316-c9922e7cf2b9, kind: Service { id: 4d1bdec4-0663-468f-bb89-b96fff034657 }, name: Name("nexus-4d1bdec4-0663-468f-bb89-b96fff034657"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 096513f0-6d94-4974-87a2-9e741040b3b2, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 5999e378-1f79-4168-8a6a-5d8d11f28d0a, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } } } }, OmicronZoneConfig { id: 9511f61f-1edb-4d24-a509-9c9b254b4140, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: ccb06e1c-4a35-4235-bfa3-e29a6c11de1f, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 5c60333f-efb9-4294-9c05-3e9e4c2e2db0, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: de0ea5f6-91a8-49f8-9128-3fe81d55dc03, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External } } } }, OmicronZoneConfig { id: d352032a-a276-4106-85fe-e58b7a8b3523, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External } } } }, OmicronZoneConfig { id: 95914e94-487b-4d05-b885-fd641f76c051, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External } } } }, OmicronZoneConfig { id: c943c63c-03aa-4d7d-a61a-aab5a8813249, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External } } } }, OmicronZoneConfig { id: 614d18fe-4403-46b9-a272-c2a23667d5b6, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 23aa2b80-399b-4aab-a2c5-d09d86b078ae, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a257a7eb-942f-4c01-b851-a8222ad60649 (zpool), kind: External } } } }, OmicronZoneConfig { id: 51fbbfd5-0a88-49fb-8db8-41b93aa3c01e, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 45089a3d-a9b7-44c7-aa98-3f45b63d8292 (zpool), kind: External } } } }, OmicronZoneConfig { id: c791aaa3-3d02-41ea-b56a-14c14d9a65b4, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 23cf064d-a4cd-4feb-84b2-17213c849d5e (zpool), kind: External } } } }, OmicronZoneConfig { id: 5e8df841-9a79-4eb9-b80b-d502210b51b2, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9f55bff5-f174-4d84-8f88-80c856df8730 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
9222024-05-16T00:46:27.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47694
9232024-05-16T00:46:27.213ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9242024-05-16T00:46:27.213ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 28e2255e-9cdb-495f-97fa-d87100d3cc79, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: InternalDns }, responder: ... }
9252024-05-16T00:46:27.235ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9262024-05-16T00:46:27.235ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: be423f23-fd69-4b81-8a1e-bf9c875e02ec, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: InternalDns }, responder: ... }
9272024-05-16T00:46:27.254ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9282024-05-16T00:46:27.254ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 403c1562-69cb-4d5b-9ec3-a628607b35b6, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9292024-05-16T00:46:27.272ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: fc80b00d-30b4-43ce-8aff-0aff0c3a62d8, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9302024-05-16T00:46:27.272ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: fc80b00d-30b4-43ce-8aff-0aff0c3a62d8, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9312024-05-16T00:46:27.292ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2c6c0aa6-9566-444d-ac70-2049e43e6e2d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9322024-05-16T00:46:27.292ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2c6c0aa6-9566-444d-ac70-2049e43e6e2d, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9332024-05-16T00:46:27.310ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c8a81356-5955-41a7-8084-4412d883857b, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9342024-05-16T00:46:27.310ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c8a81356-5955-41a7-8084-4412d883857b, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9352024-05-16T00:46:27.327ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f9109eb7-707a-48b6-b731-30d76c9dfbfa, dataset_name: DatasetName { pool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9362024-05-16T00:46:27.327ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: f9109eb7-707a-48b6-b731-30d76c9dfbfa, dataset_name: DatasetName { pool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9372024-05-16T00:46:27.346ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 396090a1-23c0-490d-82cb-1cdd686a90de, dataset_name: DatasetName { pool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9382024-05-16T00:46:27.346ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 396090a1-23c0-490d-82cb-1cdd686a90de, dataset_name: DatasetName { pool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9392024-05-16T00:46:27.363ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 55e42f05-d8aa-4cb2-94c1-93db88708faf, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9402024-05-16T00:46:27.363ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 55e42f05-d8aa-4cb2-94c1-93db88708faf, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9412024-05-16T00:46:27.416ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ecc3cc87-d31b-4070-8357-42402a3de4ca, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9422024-05-16T00:46:27.416ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: ecc3cc87-d31b-4070-8357-42402a3de4ca, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9432024-05-16T00:46:27.490ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5999e378-1f79-4168-8a6a-5d8d11f28d0a, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
9442024-05-16T00:46:27.490ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5999e378-1f79-4168-8a6a-5d8d11f28d0a, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9452024-05-16T00:46:27.544ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: de0ea5f6-91a8-49f8-9128-3fe81d55dc03, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9462024-05-16T00:46:27.544ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: de0ea5f6-91a8-49f8-9128-3fe81d55dc03, dataset_name: DatasetName { pool_name: ZpoolName { id: aee2f8e5-ad05-48a0-89c1-d42f21fddf5a (zpool), kind: External }, kind: Crucible }, responder: ... }
9472024-05-16T00:46:27.596ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d352032a-a276-4106-85fe-e58b7a8b3523, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9482024-05-16T00:46:27.596ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d352032a-a276-4106-85fe-e58b7a8b3523, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ca53e61-8a62-423d-bd09-0f828836f86b (zpool), kind: External }, kind: Crucible }, responder: ... }
9492024-05-16T00:46:27.656ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 95914e94-487b-4d05-b885-fd641f76c051, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9502024-05-16T00:46:27.656ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 95914e94-487b-4d05-b885-fd641f76c051, dataset_name: DatasetName { pool_name: ZpoolName { id: a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81 (zpool), kind: External }, kind: Crucible }, responder: ... }
9512024-05-16T00:46:27.709ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c943c63c-03aa-4d7d-a61a-aab5a8813249, dataset_name: DatasetName { pool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9522024-05-16T00:46:27.709ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c943c63c-03aa-4d7d-a61a-aab5a8813249, dataset_name: DatasetName { pool_name: ZpoolName { id: e4892d21-b561-4f79-8b36-35f2ad012b54 (zpool), kind: External }, kind: Crucible }, responder: ... }
9532024-05-16T00:46:27.760ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 614d18fe-4403-46b9-a272-c2a23667d5b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9542024-05-16T00:46:27.760ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 614d18fe-4403-46b9-a272-c2a23667d5b6, dataset_name: DatasetName { pool_name: ZpoolName { id: 76f4c53b-96f2-4a50-a841-163cf47f5db0 (zpool), kind: External }, kind: Crucible }, responder: ... }
9552024-05-16T00:46:27.818ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 23aa2b80-399b-4aab-a2c5-d09d86b078ae, dataset_name: DatasetName { pool_name: ZpoolName { id: a257a7eb-942f-4c01-b851-a8222ad60649 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9562024-05-16T00:46:27.818ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 23aa2b80-399b-4aab-a2c5-d09d86b078ae, dataset_name: DatasetName { pool_name: ZpoolName { id: a257a7eb-942f-4c01-b851-a8222ad60649 (zpool), kind: External }, kind: Crucible }, responder: ... }
9572024-05-16T00:46:27.873ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 51fbbfd5-0a88-49fb-8db8-41b93aa3c01e, dataset_name: DatasetName { pool_name: ZpoolName { id: 45089a3d-a9b7-44c7-aa98-3f45b63d8292 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9582024-05-16T00:46:27.873ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 51fbbfd5-0a88-49fb-8db8-41b93aa3c01e, dataset_name: DatasetName { pool_name: ZpoolName { id: 45089a3d-a9b7-44c7-aa98-3f45b63d8292 (zpool), kind: External }, kind: Crucible }, responder: ... }
9592024-05-16T00:46:27.926ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c791aaa3-3d02-41ea-b56a-14c14d9a65b4, dataset_name: DatasetName { pool_name: ZpoolName { id: 23cf064d-a4cd-4feb-84b2-17213c849d5e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9602024-05-16T00:46:27.926ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c791aaa3-3d02-41ea-b56a-14c14d9a65b4, dataset_name: DatasetName { pool_name: ZpoolName { id: 23cf064d-a4cd-4feb-84b2-17213c849d5e (zpool), kind: External }, kind: Crucible }, responder: ... }
9612024-05-16T00:46:27.977ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5e8df841-9a79-4eb9-b80b-d502210b51b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 9f55bff5-f174-4d84-8f88-80c856df8730 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9622024-05-16T00:46:27.977ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5e8df841-9a79-4eb9-b80b-d502210b51b2, dataset_name: DatasetName { pool_name: ZpoolName { id: 9f55bff5-f174-4d84-8f88-80c856df8730 (zpool), kind: External }, kind: Crucible }, responder: ... }
9632024-05-16T00:46:28.032ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9642024-05-16T00:46:28.032ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/omicron-zones.json file = common/src/ledger.rs:177
9652024-05-16T00:46:28.032ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/omicron-zones.json file = common/src/ledger.rs:177
9662024-05-16T00:46:28.032ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9672024-05-16T00:46:28.133ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9682024-05-16T00:46:28.134ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9692024-05-16T00:46:28.134ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9702024-05-16T00:46:28.160ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9712024-05-16T00:46:28.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9722024-05-16T00:46:28.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9732024-05-16T00:46:28.160ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9742024-05-16T00:46:28.172ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9752024-05-16T00:46:28.172ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9762024-05-16T00:46:28.184ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9772024-05-16T00:46:28.185ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9782024-05-16T00:46:28.322ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9792024-05-16T00:46:28.322ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9802024-05-16T00:46:28.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9812024-05-16T00:46:28.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9822024-05-16T00:46:28.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9832024-05-16T00:46:28.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9842024-05-16T00:46:28.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9852024-05-16T00:46:28.387ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9862024-05-16T00:46:28.387ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2 file = illumos-utils/src/zone.rs:315
9872024-05-16T00:46:28.392ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2 file = illumos-utils/src/zone.rs:315
9882024-05-16T00:46:28.397ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a file = illumos-utils/src/zone.rs:315
9892024-05-16T00:46:28.401ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140 file = illumos-utils/src/zone.rs:315
9902024-05-16T00:46:28.406ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0 file = illumos-utils/src/zone.rs:315
9912024-05-16T00:46:28.410ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523 file = illumos-utils/src/zone.rs:315
9922024-05-16T00:46:28.415ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f file = illumos-utils/src/zone.rs:315
9932024-05-16T00:46:28.553ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2 file = illumos-utils/src/zone.rs:354
9942024-05-16T00:46:28.560ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2 file = illumos-utils/src/zone.rs:354
9952024-05-16T00:46:28.565ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a file = illumos-utils/src/zone.rs:354
9962024-05-16T00:46:28.571ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140 file = illumos-utils/src/zone.rs:354
9972024-05-16T00:46:28.576ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0 file = illumos-utils/src/zone.rs:354
9982024-05-16T00:46:28.583ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523 file = illumos-utils/src/zone.rs:354
9992024-05-16T00:46:28.590ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f file = illumos-utils/src/zone.rs:354
10002024-05-16T00:46:28.596ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051 file = illumos-utils/src/zone.rs:315
10012024-05-16T00:46:28.602ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249 file = illumos-utils/src/zone.rs:315
10022024-05-16T00:46:28.607ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e file = illumos-utils/src/zone.rs:315
10032024-05-16T00:46:28.614ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03 file = illumos-utils/src/zone.rs:315
10042024-05-16T00:46:28.621ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae file = illumos-utils/src/zone.rs:315
10052024-05-16T00:46:28.627ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6 file = illumos-utils/src/zone.rs:315
10062024-05-16T00:46:28.633ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4 file = illumos-utils/src/zone.rs:315
10072024-05-16T00:46:28.640ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051 file = illumos-utils/src/zone.rs:354
10082024-05-16T00:46:28.648ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249 file = illumos-utils/src/zone.rs:354
10092024-05-16T00:46:28.654ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e file = illumos-utils/src/zone.rs:354
10102024-05-16T00:46:28.661ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03 file = illumos-utils/src/zone.rs:354
10112024-05-16T00:46:28.668ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae file = illumos-utils/src/zone.rs:354
10122024-05-16T00:46:28.675ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6 file = illumos-utils/src/zone.rs:354
10132024-05-16T00:46:28.682ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4 file = illumos-utils/src/zone.rs:354
10142024-05-16T00:46:28.755ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10152024-05-16T00:46:28.856ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10162024-05-16T00:46:28.947ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10172024-05-16T00:46:29.008ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10182024-05-16T00:46:29.081ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10192024-05-16T00:46:29.084ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10202024-05-16T00:46:29.084ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10212024-05-16T00:46:29.183ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 181, 158]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte1" } }
10222024-05-16T00:46:29.183ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10232024-05-16T00:46:29.187ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10242024-05-16T00:46:29.187ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10252024-05-16T00:46:29.341ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 138, 194]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte2" } }
10262024-05-16T00:46:29.341ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10272024-05-16T00:46:29.352ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10282024-05-16T00:46:29.364ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10292024-05-16T00:46:29.526ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 190, 109]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte3" } }
10302024-05-16T00:46:29.526ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10312024-05-16T00:46:29.530ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10322024-05-16T00:46:29.530ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10332024-05-16T00:46:29.765ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte4", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 148, 67]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte4" } }
10342024-05-16T00:46:29.766ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10352024-05-16T00:46:29.771ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10362024-05-16T00:46:29.771ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10372024-05-16T00:46:29.896ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte5", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 199, 211]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte5" } }
10382024-05-16T00:46:29.896ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10392024-05-16T00:46:29.897ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10402024-05-16T00:46:29.897ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10412024-05-16T00:46:29.897ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10422024-05-16T00:46:29.897ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10432024-05-16T00:46:29.897ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10442024-05-16T00:46:29.897ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10452024-05-16T00:46:29.897ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10462024-05-16T00:46:29.898ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10472024-05-16T00:46:29.901ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10482024-05-16T00:46:29.906ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10492024-05-16T00:46:29.908ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10502024-05-16T00:46:29.908ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10512024-05-16T00:46:29.908ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10522024-05-16T00:46:29.912ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10532024-05-16T00:46:29.915ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10542024-05-16T00:46:29.915ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10552024-05-16T00:46:29.915ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10562024-05-16T00:46:29.915ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10572024-05-16T00:46:30.638ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10582024-05-16T00:46:30.678ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10592024-05-16T00:46:30.678ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657 file = illumos-utils/src/zone.rs:315
10602024-05-16T00:46:30.688ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf file = illumos-utils/src/zone.rs:315
10612024-05-16T00:46:30.698ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0 file = illumos-utils/src/zone.rs:315
10622024-05-16T00:46:30.708ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca file = illumos-utils/src/zone.rs:315
10632024-05-16T00:46:30.765ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657 file = illumos-utils/src/zone.rs:354
10642024-05-16T00:46:30.774ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf file = illumos-utils/src/zone.rs:354
10652024-05-16T00:46:30.783ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0 file = illumos-utils/src/zone.rs:354
10662024-05-16T00:46:30.790ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca file = illumos-utils/src/zone.rs:354
10672024-05-16T00:46:30.798ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3 file = illumos-utils/src/zone.rs:315
10682024-05-16T00:46:30.833ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3 file = illumos-utils/src/zone.rs:354
10692024-05-16T00:46:38.238ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10702024-05-16T00:46:38.410ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10712024-05-16T00:46:38.411ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
10722024-05-16T00:46:38.427ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
10732024-05-16T00:46:39.288ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10742024-05-16T00:46:39.409ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="97f8acdb-1f88-4ff9-b6bd-76efd8927f9c"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10752024-05-16T00:46:39.429ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_23cf064d-a4cd-4feb-84b2-17213c849d5e/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="bd8eaab0-ebd6-4b6c-b43f-7ff2e2bb23bd"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10762024-05-16T00:46:39.429ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
10772024-05-16T00:46:39.469ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_2ca53e61-8a62-423d-bd09-0f828836f86b/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="577f9177-5089-4924-9519-ccff14c978f6"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10782024-05-16T00:46:39.469ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
10792024-05-16T00:46:39.489ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_e4892d21-b561-4f79-8b36-35f2ad012b54/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="4c221282-946f-4281-8c6c-52b05e5a4dea"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10802024-05-16T00:46:39.547ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_45089a3d-a9b7-44c7-aa98-3f45b63d8292/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="ee250898-5fa8-423b-95a7-4c46457bf41a"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10812024-05-16T00:46:39.547ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
10822024-05-16T00:46:39.554ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="096513f0-6d94-4974-87a2-9e741040b3b2"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10832024-05-16T00:46:39.625ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
10842024-05-16T00:46:39.651ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
10852024-05-16T00:46:39.689ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
10862024-05-16T00:46:39.764ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_a257a7eb-942f-4c01-b851-a8222ad60649/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="1734f673-eccc-41af-b34a-a91543febfad"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10872024-05-16T00:46:39.765ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_76f4c53b-96f2-4a50-a841-163cf47f5db0/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="109dd6b5-84b0-4a64-a641-a8f016d70f4b"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10882024-05-16T00:46:39.833ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_9f55bff5-f174-4d84-8f88-80c856df8730/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="6d8f5564-0944-4b76-80bf-14a66e4fceee"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10892024-05-16T00:46:39.833ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
10902024-05-16T00:46:39.841ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_aee2f8e5-ad05-48a0-89c1-d42f21fddf5a/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="03a3cc85-b984-44c7-a802-315123420c81"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10912024-05-16T00:46:39.856ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
10922024-05-16T00:46:39.859ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
10932024-05-16T00:46:39.865ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
10942024-05-16T00:46:39.870ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
10952024-05-16T00:46:39.888ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32790
10962024-05-16T00:46:39.890ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 1336 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32790 req_id = c55fca78-628c-4fe0-83ed-9f85be4609f3 response_code = 200 uri = /baseboard
10972024-05-16T00:46:40.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 46.75496ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
10982024-05-16T00:46:40.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 73.420982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
10992024-05-16T00:46:40.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 49.64753ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
11002024-05-16T00:46:40.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 28.8387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
11012024-05-16T00:46:40.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 32.611241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
11022024-05-16T00:46:40.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 53.262359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
11032024-05-16T00:46:40.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 37.499522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
11042024-05-16T00:46:40.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 43.808134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
11052024-05-16T00:46:40.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 38.99033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
11062024-05-16T00:46:40.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 67.773771ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
11072024-05-16T00:46:40.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 51.287445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
11082024-05-16T00:46:41.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 65.094107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
11092024-05-16T00:46:41.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 138.040573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
11102024-05-16T00:46:41.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 148.416605ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
11112024-05-16T00:46:41.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 129.356135ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
11122024-05-16T00:46:41.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 136.462953ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
11132024-05-16T00:46:41.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 54.885287ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
11142024-05-16T00:46:41.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 64.747659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
11152024-05-16T00:46:41.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 63.634489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
11162024-05-16T00:46:41.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 146.800873ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
11172024-05-16T00:46:41.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 59.064557ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
11182024-05-16T00:46:41.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 70.696986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
11192024-05-16T00:46:41.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 143.37031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
11202024-05-16T00:46:41.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 86.239911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
11212024-05-16T00:46:41.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 142.206361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
11222024-05-16T00:46:41.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 167.825373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
11232024-05-16T00:46:41.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 275.52739ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
11242024-05-16T00:46:41.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 272.390586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
11252024-05-16T00:46:41.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 294.202184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
11262024-05-16T00:46:41.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 117.142508ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
11272024-05-16T00:46:41.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 230.619128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
11282024-05-16T00:46:41.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 292.400801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
11292024-05-16T00:46:41.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 135.336492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
11302024-05-16T00:46:41.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 143.259827ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
11312024-05-16T00:46:41.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 108.952657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
11322024-05-16T00:46:41.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 115.44223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
11332024-05-16T00:46:41.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 204.227134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
11342024-05-16T00:46:41.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 292.757762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
11352024-05-16T00:46:41.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 324.779284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
11362024-05-16T00:46:41.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 175.774671ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
11372024-05-16T00:46:41.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 331.124085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
11382024-05-16T00:46:41.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 224.014974ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
11392024-05-16T00:46:41.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 315.313189ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
11402024-05-16T00:46:41.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 250.140545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
11412024-05-16T00:46:41.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 262.263877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
11422024-05-16T00:46:41.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 592.734086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
11432024-05-16T00:46:41.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 364.401342ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
11442024-05-16T00:46:41.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 314.32695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
11452024-05-16T00:46:41.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 247.949695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
11462024-05-16T00:46:41.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 395.313416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
11472024-05-16T00:46:41.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 211.517775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
11482024-05-16T00:46:41.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 515.199042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
11492024-05-16T00:46:41.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 871.173075ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
11502024-05-16T00:46:41.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 459.108923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
11512024-05-16T00:46:41.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 537.559107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
11522024-05-16T00:46:41.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 1.171557815s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
11532024-05-16T00:46:41.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 920.696813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
11542024-05-16T00:46:41.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 837.155479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
11552024-05-16T00:46:41.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.164950978s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
11562024-05-16T00:46:41.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 1.043476907s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
11572024-05-16T00:46:42.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 1.139478849s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
11582024-05-16T00:46:42.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 894.039963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
11592024-05-16T00:46:42.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 713.78698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
11602024-05-16T00:46:42.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 951.266376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
11612024-05-16T00:46:42.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 503.386954ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
11622024-05-16T00:46:42.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 1.159957573s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
11632024-05-16T00:46:42.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 1.421417881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
11642024-05-16T00:46:42.632ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 119.076602105s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
11652024-05-16T00:46:42.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 858.412188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
11662024-05-16T00:46:42.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 1.138112294s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
11672024-05-16T00:46:42.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 661.085102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
11682024-05-16T00:46:42.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 723.805201ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
11692024-05-16T00:46:42.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 1.316563565s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
11702024-05-16T00:46:42.941ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11712024-05-16T00:46:42.941ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
11722024-05-16T00:46:42.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 1.316324702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
11732024-05-16T00:46:43.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 908.222033ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
11742024-05-16T00:46:43.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 553.110798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
11752024-05-16T00:46:43.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.39496344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
11762024-05-16T00:46:43.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 786.137103ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
11772024-05-16T00:46:43.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 40.634341ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
11782024-05-16T00:46:43.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 736.841267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
11792024-05-16T00:46:43.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 77.728048ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
11802024-05-16T00:46:43.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 271.543473ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
11812024-05-16T00:46:43.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 1.13924971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
11822024-05-16T00:46:43.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 738.267495ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
11832024-05-16T00:46:43.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 1.491419501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
11842024-05-16T00:46:43.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 550.152191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
11852024-05-16T00:46:43.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 687.031068ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
11862024-05-16T00:46:43.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 313.444318ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
11872024-05-16T00:46:43.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 894.571315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
11882024-05-16T00:46:43.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 915.42132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
11892024-05-16T00:46:43.856ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902024-05-16T00:46:43.856ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
11912024-05-16T00:46:43.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 703.990449ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
11922024-05-16T00:46:43.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 1.125717534s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
11932024-05-16T00:46:43.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 943.834804ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
11942024-05-16T00:46:44.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 1.355275589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
11952024-05-16T00:46:44.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 28.147676ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
11962024-05-16T00:46:44.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 90.556259ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
11972024-05-16T00:46:44.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 1.34936204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
11982024-05-16T00:46:44.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 1.152525803s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
11992024-05-16T00:46:44.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 182.056285ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
12002024-05-16T00:46:44.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 761.347397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
12012024-05-16T00:46:44.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 530.185785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
12022024-05-16T00:46:44.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 1.051811795s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
12032024-05-16T00:46:44.457ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 848.080663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
12042024-05-16T00:46:44.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 481.969449ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
12052024-05-16T00:46:44.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 534.602492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
12062024-05-16T00:46:44.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 1.333203912s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
12072024-05-16T00:46:44.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 662.70039ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
12082024-05-16T00:46:44.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 1.107855182s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
12092024-05-16T00:46:44.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 1.163047025s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
12102024-05-16T00:46:44.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 1.288958381s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
12112024-05-16T00:46:44.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 1.017045928s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
12122024-05-16T00:46:45.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 1.405799891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
12132024-05-16T00:46:45.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 724.556101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
12142024-05-16T00:46:45.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 1.469658896s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
12152024-05-16T00:46:45.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 1.308147755s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
12162024-05-16T00:46:45.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.250664065s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
12172024-05-16T00:46:45.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 1.074228209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
12182024-05-16T00:46:45.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 1.034653266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
12192024-05-16T00:46:45.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 1.081287509s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
12202024-05-16T00:46:45.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 1.12810711s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
12212024-05-16T00:46:45.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 872.88086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
12222024-05-16T00:46:45.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 1.220638733s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
12232024-05-16T00:46:45.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 1.238492935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
12242024-05-16T00:46:45.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 511.152421ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
12252024-05-16T00:46:46.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 1.192800026s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
12262024-05-16T00:46:46.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 1.329189062s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
12272024-05-16T00:46:46.205ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12282024-05-16T00:46:46.224ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
12292024-05-16T00:46:46.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 1.430062126s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
12302024-05-16T00:46:46.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 726.195035ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
12312024-05-16T00:46:46.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 67.902472ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
12322024-05-16T00:46:46.435ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12332024-05-16T00:46:46.435ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
12342024-05-16T00:46:46.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 646.576482ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
12352024-05-16T00:46:46.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 702.577212ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
12362024-05-16T00:46:46.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 800.967053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
12372024-05-16T00:46:46.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 1.11634896s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
12382024-05-16T00:46:46.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 63.739691ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
12392024-05-16T00:46:46.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 558.813501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
12402024-05-16T00:46:46.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 614.915773ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
12412024-05-16T00:46:46.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 169.755976ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
12422024-05-16T00:46:46.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 1.05835s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
12432024-05-16T00:46:46.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 503.89805ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
12442024-05-16T00:46:46.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.170149069s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
12452024-05-16T00:46:46.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 66.424095ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
12462024-05-16T00:46:46.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 398.172816ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
12472024-05-16T00:46:46.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 66.243241ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
12482024-05-16T00:46:46.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 118.200394ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
12492024-05-16T00:46:47.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 452.904ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
12502024-05-16T00:46:47.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 887.084801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
12512024-05-16T00:46:47.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 979.168644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
12522024-05-16T00:46:47.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 782.522164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
12532024-05-16T00:46:47.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 914.171015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
12542024-05-16T00:46:47.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 842.656942ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
12552024-05-16T00:46:47.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 1.446540186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
12562024-05-16T00:46:47.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 903.398752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
12572024-05-16T00:46:47.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 938.990337ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
12582024-05-16T00:46:47.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 1.497850119s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
12592024-05-16T00:46:47.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 627.027563ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
12602024-05-16T00:46:47.263ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12612024-05-16T00:46:47.263ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
12622024-05-16T00:46:47.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 1.07640389s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
12632024-05-16T00:46:47.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 622.021457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
12642024-05-16T00:46:47.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 728.249597ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
12652024-05-16T00:46:47.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 1.483473948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
12662024-05-16T00:46:47.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 986.241071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
12672024-05-16T00:46:47.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 1.432724139s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
12682024-05-16T00:46:47.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 33.937817ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
12692024-05-16T00:46:47.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 86.672166ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
12702024-05-16T00:46:47.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.40173435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
12712024-05-16T00:46:47.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 286.76572ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
12722024-05-16T00:46:47.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 508.34926ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
12732024-05-16T00:46:47.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 1.148859667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
12742024-05-16T00:46:47.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 760.710606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
12752024-05-16T00:46:48.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 871.074324ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
12762024-05-16T00:46:48.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 1.292830146s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
12772024-05-16T00:46:48.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 647.817528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
12782024-05-16T00:46:48.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 543.003925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
12792024-05-16T00:46:48.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 1.49137631s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
12802024-05-16T00:46:48.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 969.833595ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
12812024-05-16T00:46:48.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 202.244759ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
12822024-05-16T00:46:48.198ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832024-05-16T00:46:48.198ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
12842024-05-16T00:46:48.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 844.055631ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
12852024-05-16T00:46:48.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 601.971934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
12862024-05-16T00:46:48.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 743.250445ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
12872024-05-16T00:46:48.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 779.297404ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
12882024-05-16T00:46:48.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 43.958198ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
12892024-05-16T00:46:48.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 140.436155ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
12902024-05-16T00:46:48.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 293.74576ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
12912024-05-16T00:46:48.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 736.430743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
12922024-05-16T00:46:48.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 779.358235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
12932024-05-16T00:46:48.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 817.453503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
12942024-05-16T00:46:48.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 716.289757ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
12952024-05-16T00:46:48.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 1.279016276s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
12962024-05-16T00:46:48.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 1.067059365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
12972024-05-16T00:46:48.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 1.016028993s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
12982024-05-16T00:46:48.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 297.234018ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
12992024-05-16T00:46:48.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 952.220374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
13002024-05-16T00:46:49.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 767.242474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
13012024-05-16T00:46:49.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 1.321279421s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
13022024-05-16T00:46:49.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 637.55331ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
13032024-05-16T00:46:49.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 1.105007754s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
13042024-05-16T00:46:49.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 1.311555621s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
13052024-05-16T00:46:49.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 1.170583865s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
13062024-05-16T00:46:49.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 726.828225ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
13072024-05-16T00:46:49.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 917.151841ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
13082024-05-16T00:46:49.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.481190717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
13092024-05-16T00:46:49.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 1.303228654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
13102024-05-16T00:46:49.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 1.42787002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
13112024-05-16T00:46:49.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 646.283459ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
13122024-05-16T00:46:49.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 918.062177ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
13132024-05-16T00:46:49.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 1.060315569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
13142024-05-16T00:46:49.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 1.222088769s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
13152024-05-16T00:46:49.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 1.221983264s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
13162024-05-16T00:46:49.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 1.200167625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
13172024-05-16T00:46:49.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 726.239651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
13182024-05-16T00:46:49.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 838.439906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
13192024-05-16T00:46:49.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 1.045954252s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
13202024-05-16T00:46:49.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 1.069733616s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
13212024-05-16T00:46:50.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 905.335634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
13222024-05-16T00:46:50.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 876.665868ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
13232024-05-16T00:46:50.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 1.226207401s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
13242024-05-16T00:46:50.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 1.11305088s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
13252024-05-16T00:46:50.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 1.249815688s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
13262024-05-16T00:46:50.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 763.75953ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
13272024-05-16T00:46:50.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 1.474663451s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
13282024-05-16T00:46:50.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 1.381837403s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
13292024-05-16T00:46:50.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 654.794619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
13302024-05-16T00:46:50.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 607.90723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
13312024-05-16T00:46:50.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 505.141073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
13322024-05-16T00:46:50.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 587.152489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
13332024-05-16T00:46:50.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 952.686313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
13342024-05-16T00:46:50.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 689.309695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
13352024-05-16T00:46:50.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 741.017318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
13362024-05-16T00:46:50.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 1.1545234s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
13372024-05-16T00:46:50.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 742.824132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
13382024-05-16T00:46:50.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 1.036257793s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
13392024-05-16T00:46:51.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 990.312302ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
13402024-05-16T00:46:51.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 1.405269326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
13412024-05-16T00:46:51.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 1.013704485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
13422024-05-16T00:46:51.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 512.022633ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
13432024-05-16T00:46:51.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 897.567127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
13442024-05-16T00:46:51.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 900.857773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
13452024-05-16T00:46:51.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 1.033798355s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
13462024-05-16T00:46:51.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.338342649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
13472024-05-16T00:46:51.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 1.018293276s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
13482024-05-16T00:46:51.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 874.928864ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
13492024-05-16T00:46:51.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 900.617025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
13502024-05-16T00:46:51.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 1.32800038s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
13512024-05-16T00:46:51.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 1.00402388s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
13522024-05-16T00:46:51.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 1.082328945s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
13532024-05-16T00:46:51.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 589.873927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
13542024-05-16T00:46:51.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 634.227198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
13552024-05-16T00:46:51.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 1.316663285s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
13562024-05-16T00:46:51.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 735.379576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
13572024-05-16T00:46:52.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 891.460634ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
13582024-05-16T00:46:52.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 1.199339809s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
13592024-05-16T00:46:52.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 693.230171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
13602024-05-16T00:46:52.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 1.063049651s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
13612024-05-16T00:46:52.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 1.349150759s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
13622024-05-16T00:46:52.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 641.72442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
13632024-05-16T00:46:52.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 642.529963ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
13642024-05-16T00:46:52.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 1.36008371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
13652024-05-16T00:46:52.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 1.211882125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
13662024-05-16T00:46:52.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 1.299876156s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
13672024-05-16T00:46:52.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 1.465262851s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
13682024-05-16T00:46:52.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 652.279207ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
13692024-05-16T00:46:52.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 1.062535239s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
13702024-05-16T00:46:52.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 582.911891ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
13712024-05-16T00:46:52.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 844.040272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
13722024-05-16T00:46:52.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.431680648s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
13732024-05-16T00:46:52.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 1.466462142s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
13742024-05-16T00:46:52.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 1.361568214s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
13752024-05-16T00:46:52.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 1.284623992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
13762024-05-16T00:46:52.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 788.547027ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
13772024-05-16T00:46:52.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 900.323791ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
13782024-05-16T00:46:52.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 1.444093248s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
13792024-05-16T00:46:53.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 955.953943ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
13802024-05-16T00:46:53.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 1.094881585s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
13812024-05-16T00:46:53.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 1.497706501s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
13822024-05-16T00:46:53.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 1.269362349s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
13832024-05-16T00:46:53.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 1.122462692s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
13842024-05-16T00:46:53.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 689.315854ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
13852024-05-16T00:46:53.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 1.16229504s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
13862024-05-16T00:46:53.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140") failed: Property not found. retry in 1.398888638s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
13872024-05-16T00:46:53.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 1.174712178s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
13882024-05-16T00:46:53.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 685.905198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
13892024-05-16T00:46:53.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 1.264621101s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
13902024-05-16T00:46:53.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 1.15766138s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
13912024-05-16T00:46:53.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 1.425744189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
13922024-05-16T00:46:53.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 693.383574ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
13932024-05-16T00:46:54.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 1.363390923s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
13942024-05-16T00:46:54.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 1.206129927s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
13952024-05-16T00:46:54.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 737.476852ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
13962024-05-16T00:46:54.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 1.177104442s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
13972024-05-16T00:46:54.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 1.026806413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
13982024-05-16T00:46:54.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 819.375993ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
13992024-05-16T00:46:54.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 1.039314652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
14002024-05-16T00:46:54.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 1.28751891s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
14012024-05-16T00:46:54.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 518.782098ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
14022024-05-16T00:46:54.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 657.121824ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
14032024-05-16T00:46:54.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 787.809556ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
14042024-05-16T00:46:54.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 1.26901373s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
14052024-05-16T00:46:54.668ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
14062024-05-16T00:46:54.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 1.407975326s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
14072024-05-16T00:46:54.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 1.039430196s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
14082024-05-16T00:46:54.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 582.112002ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
14092024-05-16T00:46:54.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 1.039864571s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
14102024-05-16T00:46:54.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.291051087s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
14112024-05-16T00:46:54.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 1.203689956s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
14122024-05-16T00:46:55.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0") failed: Property not found. retry in 1.129155283s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
14132024-05-16T00:46:55.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 591.140304ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
14142024-05-16T00:46:55.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2") failed: Property not found. retry in 1.326302915s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
14152024-05-16T00:46:55.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 1.198885478s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
14162024-05-16T00:46:55.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 819.568299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
14172024-05-16T00:46:55.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249") failed: Property not found. retry in 1.483776833s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
14182024-05-16T00:46:55.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 547.691349ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
14192024-05-16T00:46:55.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 1.085284603s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
14202024-05-16T00:46:55.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6") failed: Property not found. retry in 1.49135629s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
14212024-05-16T00:46:55.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2") failed: Property not found. retry in 1.426242106s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
14222024-05-16T00:46:55.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 713.880308ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
14232024-05-16T00:46:55.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 538.23962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
14242024-05-16T00:46:55.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf") failed: Property not found. retry in 1.20355026s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
14252024-05-16T00:46:55.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 852.224921ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
14262024-05-16T00:46:55.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca") failed: Property not found. retry in 1.210908803s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
14272024-05-16T00:46:55.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 1.099388964s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
14282024-05-16T00:46:55.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 534.838487ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
14292024-05-16T00:46:56.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523") failed: Property not found. retry in 1.388724702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
14302024-05-16T00:46:56.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 596.365166ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
14312024-05-16T00:46:56.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a") failed: Property not found. retry in 847.50305ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
14322024-05-16T00:46:56.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03") failed: Property not found. retry in 980.191675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
14332024-05-16T00:46:56.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae") failed: Property not found. retry in 1.304464271s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
14342024-05-16T00:46:56.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f") failed: Property not found. retry in 1.239210642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
14352024-05-16T00:46:56.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e") failed: Property not found. retry in 942.178054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
14362024-05-16T00:46:56.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051") failed: Property not found. retry in 614.096533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
14372024-05-16T00:46:56.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657") failed: Property not found. retry in 1.21728488s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
14382024-05-16T00:46:56.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0") failed: Property not found. retry in 831.284357ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
14392024-05-16T00:46:56.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4") failed: Property not found. retry in 1.256303976s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
14402024-05-16T00:46:57.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3") failed: Property not found. retry in 1.419722371s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
14412024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_5e8df841-9a79-4eb9-b80b-d502210b51b2
14422024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_oximeter_096513f0-6d94-4974-87a2-9e741040b3b2
14432024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_4d1bdec4-0663-468f-bb89-b96fff034657
14442024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_clickhouse_5999e378-1f79-4168-8a6a-5d8d11f28d0a
14452024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_9511f61f-1edb-4d24-a509-9c9b254b4140
14462024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_5c60333f-efb9-4294-9c05-3e9e4c2e2db0
14472024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_external_dns_55e42f05-d8aa-4cb2-94c1-93db88708faf
14482024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_d352032a-a276-4106-85fe-e58b7a8b3523
14492024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_d5d04124-9918-4bce-aa79-2388f6395fc0
14502024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_ccb06e1c-4a35-4235-bfa3-e29a6c11de1f
14512024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_external_dns_ecc3cc87-d31b-4070-8357-42402a3de4ca
14522024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_95914e94-487b-4d05-b885-fd641f76c051
14532024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_c199aa4c-85c6-4fda-8438-db73e90a5af3
14542024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_c943c63c-03aa-4d7d-a61a-aab5a8813249
14552024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_51fbbfd5-0a88-49fb-8db8-41b93aa3c01e
14562024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_de0ea5f6-91a8-49f8-9128-3fe81d55dc03
14572024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_23aa2b80-399b-4aab-a2c5-d09d86b078ae
14582024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_614d18fe-4403-46b9-a272-c2a23667d5b6
14592024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_c791aaa3-3d02-41ea-b56a-14c14d9a65b4
14602024-05-16T00:46:58.505ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14612024-05-16T00:46:58.539ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14622024-05-16T00:46:58.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 31391199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:47694 req_id = fca682ae-ef4f-44d2-987e-7e7ba8213e80 response_code = 204 uri = /omicron-zones
14632024-05-16T00:46:58.646ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1236
14642024-05-16T00:46:58.646ZINFOSledAgent (RSS): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14652024-05-16T00:46:58.647ZINFOSledAgent (RSS): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14662024-05-16T00:46:58.662ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:680
14672024-05-16T00:46:58.680ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:693
14682024-05-16T00:46:58.795ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV1 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 24, }, ), ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, } file = sled-agent/src/rack_setup/service.rs:817
14692024-05-16T00:46:59.246ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14702024-05-16T00:46:59.342ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14712024-05-16T00:46:59.495ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14722024-05-16T00:46:59.634ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14732024-05-16T00:46:59.765ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14742024-05-16T00:46:59.902ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14752024-05-16T00:47:00.132ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14762024-05-16T00:47:00.419ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14772024-05-16T00:47:00.898ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14782024-05-16T00:47:01.327ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14792024-05-16T00:47:01.833ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14802024-05-16T00:47:02.748ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14812024-05-16T00:47:03.277ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14822024-05-16T00:47:04.188ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14832024-05-16T00:47:05.492ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14842024-05-16T00:47:06.457ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14852024-05-16T00:47:07.763ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/22aa8733-7ad9-4e21-be17-4210dcf48a5e/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
14862024-05-16T00:47:09.619ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4dc86c42-d39f-4e82-84c2-49863ca17568", "content-length": "173", "date": "Thu, 16 May 2024 00:47:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"22aa8733-7ad9-4e21-be17-4210dcf48a5e\"", request_id: "4dc86c42-d39f-4e82-84c2-49863ca17568" } file = sled-agent/src/rack_setup/service.rs:879
14872024-05-16T00:47:09.955ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40507
14882024-05-16T00:47:09.966ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 10860 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40507 req_id = 7b0a172d-fc6f-488d-83b6-9131a26fbefe response_code = 200 uri = /baseboard
14892024-05-16T00:47:13.585ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "166c8528-3f95-4713-a3db-5bfe56c5882e", "content-length": "173", "date": "Thu, 16 May 2024 00:47:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ebcdcaed-e48b-4070-ab17-779f5ea072cb\"", request_id: "166c8528-3f95-4713-a3db-5bfe56c5882e" } file = sled-agent/src/rack_setup/service.rs:879
14902024-05-16T00:47:16.598ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6210ae11-041d-4781-9cb3-84574609a377", "content-length": "173", "date": "Thu, 16 May 2024 00:47:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ebcdcaed-e48b-4070-ab17-779f5ea072cb\"", request_id: "6210ae11-041d-4781-9cb3-84574609a377" } file = sled-agent/src/rack_setup/service.rs:879
14912024-05-16T00:47:20.642ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "eac2d45b-56e8-46a0-92cf-855d34aec69c", "content-length": "173", "date": "Thu, 16 May 2024 00:47:20 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ebcdcaed-e48b-4070-ab17-779f5ea072cb\"", request_id: "eac2d45b-56e8-46a0-92cf-855d34aec69c" } file = sled-agent/src/rack_setup/service.rs:879
14922024-05-16T00:47:23.595ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1104222f-fe5c-40e4-8b5a-40d4bd3c2e7f", "content-length": "173", "date": "Thu, 16 May 2024 00:47:23 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ebcdcaed-e48b-4070-ab17-779f5ea072cb\"", request_id: "1104222f-fe5c-40e4-8b5a-40d4bd3c2e7f" } file = sled-agent/src/rack_setup/service.rs:879
14932024-05-16T00:47:27.879ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2845561b-b66b-44e8-8855-fbcbf6e3a55e", "content-length": "173", "date": "Thu, 16 May 2024 00:47:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ebcdcaed-e48b-4070-ab17-779f5ea072cb\"", request_id: "2845561b-b66b-44e8-8855-fbcbf6e3a55e" } file = sled-agent/src/rack_setup/service.rs:879
14942024-05-16T00:47:33.203ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e5d1e813-b22b-4737-a248-e04a8afcb1c0", "content-length": "173", "date": "Thu, 16 May 2024 00:47:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ebcdcaed-e48b-4070-ab17-779f5ea072cb\"", request_id: "e5d1e813-b22b-4737-a248-e04a8afcb1c0" } file = sled-agent/src/rack_setup/service.rs:879
14952024-05-16T00:47:37.269ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
14962024-05-16T00:47:37.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37802
14972024-05-16T00:47:37.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14982024-05-16T00:47:37.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 90793 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37802 req_id = 185d7765-7123-402f-be24-ef47ce603129 response_code = 200 uri = /inventory
14992024-05-16T00:47:37.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15002024-05-16T00:47:37.507ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/omicron-zones.json file = common/src/ledger.rs:177
15012024-05-16T00:47:37.509ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/omicron-zones.json file = common/src/ledger.rs:177
15022024-05-16T00:47:37.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 4023 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37802 req_id = c0c941e7-e180-4cc3-8533-3f186d02e9a1 response_code = 200 uri = /omicron-zones
15032024-05-16T00:47:38.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59418
15042024-05-16T00:47:38.791ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 407bf9eb-4fe8-4336-ba89-2a02d924feb0, kind: Service { id: 55e42f05-d8aa-4cb2-94c1-93db88708faf }, name: Name("external-dns-55e42f05-d8aa-4cb2-94c1-93db88708faf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 67])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 4463ba03-6579-42ed-9daf-60d5a2bd4034, kind: Service { id: ecc3cc87-d31b-4070-8357-42402a3de4ca }, name: Name("external-dns-ecc3cc87-d31b-4070-8357-42402a3de4ca"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 109])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 38e6570f-f2b9-4258-8316-c9922e7cf2b9, kind: Service { id: 4d1bdec4-0663-468f-bb89-b96fff034657 }, name: Name("nexus-4d1bdec4-0663-468f-bb89-b96fff034657"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a9a4da95-41c7-4399-8d08-a7f8775a4ec2, kind: Service { id: d5d04124-9918-4bce-aa79-2388f6395fc0 }, name: Name("nexus-d5d04124-9918-4bce-aa79-2388f6395fc0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 194])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed5b09fd-ac17-4e3a-8880-cb9a1fe84fd7, kind: Service { id: c199aa4c-85c6-4fda-8438-db73e90a5af3 }, name: Name("nexus-c199aa4c-85c6-4fda-8438-db73e90a5af3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 211])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15052024-05-16T00:47:38.792ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
15062024-05-16T00:47:38.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15072024-05-16T00:47:38.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15082024-05-16T00:47:38.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15092024-05-16T00:47:38.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15102024-05-16T00:47:38.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15112024-05-16T00:47:38.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 5542 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59418 req_id = a1391d3a-fc7f-431f-97c6-a993a1b2fbaf response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15122024-05-16T00:47:38.794ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:889
15132024-05-16T00:47:39.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51655
15142024-05-16T00:47:39.120ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15152024-05-16T00:47:39.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 87354 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51655 req_id = 6a88d799-14ef-4a94-8975-8da9fcc3e745 response_code = 200 uri = /inventory
15162024-05-16T00:47:39.208ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15172024-05-16T00:47:39.208ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/config/omicron-zones.json file = common/src/ledger.rs:177
15182024-05-16T00:47:39.209ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/config/omicron-zones.json file = common/src/ledger.rs:177
15192024-05-16T00:47:39.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 1584 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51655 req_id = 43cdcdfc-c6e0-4e33-8774-680995f7e427 response_code = 200 uri = /omicron-zones
15202024-05-16T00:47:39.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43015
15212024-05-16T00:47:39.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 151911 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43015 req_id = 220e6f7d-d12e-42eb-a0b9-b7e23d9c4784 response_code = 204 uri = /switch-ports
15222024-05-16T00:47:39.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 1808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43015 req_id = 70c1fdeb-4393-4e07-bf7a-7e5bb2553184 response_code = 200 uri = /network-bootstore-config
15232024-05-16T00:47:39.676ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58021
15242024-05-16T00:47:39.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 79421 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58021 req_id = c0194885-1cff-4dd4-b11a-3c0444637823 response_code = 204 uri = /switch-ports
15252024-05-16T00:47:39.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35895
15262024-05-16T00:47:39.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55560
15272024-05-16T00:47:39.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 997 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58021 req_id = e6c59d40-25a0-4e67-84a6-6a2ffb6c1d4c response_code = 200 uri = /network-bootstore-config
15282024-05-16T00:47:39.757ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 407bf9eb-4fe8-4336-ba89-2a02d924feb0, kind: Service { id: 55e42f05-d8aa-4cb2-94c1-93db88708faf }, name: Name("external-dns-55e42f05-d8aa-4cb2-94c1-93db88708faf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 67])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 4463ba03-6579-42ed-9daf-60d5a2bd4034, kind: Service { id: ecc3cc87-d31b-4070-8357-42402a3de4ca }, name: Name("external-dns-ecc3cc87-d31b-4070-8357-42402a3de4ca"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 109])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 38e6570f-f2b9-4258-8316-c9922e7cf2b9, kind: Service { id: 4d1bdec4-0663-468f-bb89-b96fff034657 }, name: Name("nexus-4d1bdec4-0663-468f-bb89-b96fff034657"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a9a4da95-41c7-4399-8d08-a7f8775a4ec2, kind: Service { id: d5d04124-9918-4bce-aa79-2388f6395fc0 }, name: Name("nexus-d5d04124-9918-4bce-aa79-2388f6395fc0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 194])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed5b09fd-ac17-4e3a-8880-cb9a1fe84fd7, kind: Service { id: c199aa4c-85c6-4fda-8438-db73e90a5af3 }, name: Name("nexus-c199aa4c-85c6-4fda-8438-db73e90a5af3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 211])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15292024-05-16T00:47:39.757ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
15302024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
15312024-05-16T00:47:39.761ZINFOSledAgent (bootstore): Writing ledger to /pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15322024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 407bf9eb-4fe8-4336-ba89-2a02d924feb0, kind: Service { id: 55e42f05-d8aa-4cb2-94c1-93db88708faf }, name: Name("external-dns-55e42f05-d8aa-4cb2-94c1-93db88708faf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 67])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 4463ba03-6579-42ed-9daf-60d5a2bd4034, kind: Service { id: ecc3cc87-d31b-4070-8357-42402a3de4ca }, name: Name("external-dns-ecc3cc87-d31b-4070-8357-42402a3de4ca"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 109])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 38e6570f-f2b9-4258-8316-c9922e7cf2b9, kind: Service { id: 4d1bdec4-0663-468f-bb89-b96fff034657 }, name: Name("nexus-4d1bdec4-0663-468f-bb89-b96fff034657"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a9a4da95-41c7-4399-8d08-a7f8775a4ec2, kind: Service { id: d5d04124-9918-4bce-aa79-2388f6395fc0 }, name: Name("nexus-d5d04124-9918-4bce-aa79-2388f6395fc0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 194])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed5b09fd-ac17-4e3a-8880-cb9a1fe84fd7, kind: Service { id: c199aa4c-85c6-4fda-8438-db73e90a5af3 }, name: Name("nexus-c199aa4c-85c6-4fda-8438-db73e90a5af3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 211])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15332024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15342024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15352024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15362024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15372024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15382024-05-16T00:47:39.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 1297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35895 req_id = ff7148c8-8e34-4b74-8304-ab509442df7a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15392024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
15402024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15412024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15422024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15432024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15442024-05-16T00:47:39.761ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15452024-05-16T00:47:39.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 1310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55560 req_id = 84d815c9-5da9-4446-81fb-192d0ba06a75 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15462024-05-16T00:47:39.761ZINFOSledAgent (bootstore): Writing ledger to /pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15472024-05-16T00:47:39.761ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
15482024-05-16T00:47:39.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 5499 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43015 req_id = 2f07f690-59f3-4db8-9fce-453b5d5d5dd7 response_code = 204 uri = /network-bootstore-config
15492024-05-16T00:47:39.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61935
15502024-05-16T00:47:39.769ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 407bf9eb-4fe8-4336-ba89-2a02d924feb0, kind: Service { id: 55e42f05-d8aa-4cb2-94c1-93db88708faf }, name: Name("external-dns-55e42f05-d8aa-4cb2-94c1-93db88708faf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 67])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 4463ba03-6579-42ed-9daf-60d5a2bd4034, kind: Service { id: ecc3cc87-d31b-4070-8357-42402a3de4ca }, name: Name("external-dns-ecc3cc87-d31b-4070-8357-42402a3de4ca"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 109])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 38e6570f-f2b9-4258-8316-c9922e7cf2b9, kind: Service { id: 4d1bdec4-0663-468f-bb89-b96fff034657 }, name: Name("nexus-4d1bdec4-0663-468f-bb89-b96fff034657"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a9a4da95-41c7-4399-8d08-a7f8775a4ec2, kind: Service { id: d5d04124-9918-4bce-aa79-2388f6395fc0 }, name: Name("nexus-d5d04124-9918-4bce-aa79-2388f6395fc0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 194])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed5b09fd-ac17-4e3a-8880-cb9a1fe84fd7, kind: Service { id: c199aa4c-85c6-4fda-8438-db73e90a5af3 }, name: Name("nexus-c199aa4c-85c6-4fda-8438-db73e90a5af3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 211])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15512024-05-16T00:47:39.769ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
15522024-05-16T00:47:39.769ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15532024-05-16T00:47:39.769ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15542024-05-16T00:47:39.769ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15552024-05-16T00:47:39.769ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15562024-05-16T00:47:39.769ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15572024-05-16T00:47:39.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 471 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61935 req_id = 1c2cb2eb-63c9-463e-a5d9-a148e8aa3da9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15582024-05-16T00:47:39.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63222
15592024-05-16T00:47:39.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 49384 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63222 req_id = 35556433-2cf2-4265-b40e-5530a0d89c82 response_code = 204 uri = /switch-ports
15602024-05-16T00:47:39.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63222 req_id = 6be260f7-0675-43c3-acb1-10ba1f5f0cfb response_code = 200 uri = /network-bootstore-config
15612024-05-16T00:47:40.000ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53775
15622024-05-16T00:47:40.000ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53775 req_id = 75fa6fd4-9c96-4f53-8319-6682686f8331 response_code = 200 uri = /baseboard
15632024-05-16T00:48:09.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42643
15642024-05-16T00:48:09.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42643 req_id = 6d685cb4-89e8-4654-bd54-7dd80de25957 response_code = 204 uri = /switch-ports
15652024-05-16T00:48:09.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42643 req_id = d5de6b1e-7324-4e73-ab3e-66c6ea503b0e response_code = 200 uri = /network-bootstore-config
15662024-05-16T00:48:09.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35847
15672024-05-16T00:48:09.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 48250 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35847 req_id = 6ecc86d3-9b36-44f9-a53a-e06fc26a6e49 response_code = 204 uri = /switch-ports
15682024-05-16T00:48:09.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38441
15692024-05-16T00:48:09.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 4095 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35847 req_id = ab765e50-1d19-466b-8b83-ac78423b3d41 response_code = 200 uri = /network-bootstore-config
15702024-05-16T00:48:09.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 52977 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38441 req_id = 1f0e56b3-0107-44c5-8374-06de2b9e1fc2 response_code = 204 uri = /switch-ports
15712024-05-16T00:48:09.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38441 req_id = 57a1a6ec-5879-4df2-a29d-623965a53cfb response_code = 200 uri = /network-bootstore-config
15722024-05-16T00:48:10.034ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38753
15732024-05-16T00:48:10.035ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38753 req_id = 26219b6f-d269-475c-910c-a0a4e89f7de4 response_code = 200 uri = /baseboard
15742024-05-16T00:48:39.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54139
15752024-05-16T00:48:39.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 47936 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54139 req_id = 4e38128d-3f52-4ef8-9a5c-b9d8fbcd1448 response_code = 204 uri = /switch-ports
15762024-05-16T00:48:39.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54139 req_id = 1a2e939e-24e3-4677-b9f5-a5f02d49f055 response_code = 200 uri = /network-bootstore-config
15772024-05-16T00:48:39.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48012
15782024-05-16T00:48:39.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 47689 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48012 req_id = 1be3649d-6233-4ae3-826f-45fb9a8f62fb response_code = 204 uri = /switch-ports
15792024-05-16T00:48:39.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 751 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48012 req_id = 55e17c03-ec9a-4cb7-8721-d170d6e44c7e response_code = 200 uri = /network-bootstore-config
15802024-05-16T00:48:39.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40895
15812024-05-16T00:48:39.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 44147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40895 req_id = e9470fbb-b2df-4e70-bf92-8de5cfeb692a response_code = 204 uri = /switch-ports
15822024-05-16T00:48:39.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40895 req_id = 5e27ca3b-87aa-42d5-a75d-85e92e13e8f7 response_code = 200 uri = /network-bootstore-config
15832024-05-16T00:48:40.072ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34207
15842024-05-16T00:48:40.073ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34207 req_id = d67c646a-399b-4bea-ada7-b024df1decc3 response_code = 200 uri = /baseboard
15852024-05-16T00:49:09.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63406
15862024-05-16T00:49:09.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 50028 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63406 req_id = 790715a3-3963-45c8-ae8e-d4e41f492e55 response_code = 204 uri = /switch-ports
15872024-05-16T00:49:09.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63406 req_id = 14c18dbb-8b0c-4301-a736-f6aa4dd36b7c response_code = 200 uri = /network-bootstore-config
15882024-05-16T00:49:09.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62877
15892024-05-16T00:49:09.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 41376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62877 req_id = 8a15e558-8f21-4d0d-b98d-87dbfd11de4f response_code = 204 uri = /switch-ports
15902024-05-16T00:49:09.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62877 req_id = 7c908343-4868-470e-af8e-021f810c9571 response_code = 200 uri = /network-bootstore-config
15912024-05-16T00:49:09.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38925
15922024-05-16T00:49:09.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 46024 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38925 req_id = 2b757e17-eed8-4b08-b3b1-2b8da6e40e89 response_code = 204 uri = /switch-ports
15932024-05-16T00:49:09.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38925 req_id = 393a8eee-2f55-4d5d-a576-f4c9b82d88fe response_code = 200 uri = /network-bootstore-config
15942024-05-16T00:49:10.107ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52168
15952024-05-16T00:49:10.107ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 82 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52168 req_id = 5068d987-8c86-4bfd-9c27-3f829051622d response_code = 200 uri = /baseboard
15962024-05-16T00:49:11.855ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:37133 remote_addr = [fd00:1122:3344:101::d]:39143 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb
15972024-05-16T00:49:11.868ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 11567 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = 1dc9e644-4401-45e1-887d-9489d75bfac2 response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
15982024-05-16T00:49:39.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62091
15992024-05-16T00:49:39.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62091 req_id = 0e45e6fa-af71-4c2b-9e2c-3aa4e2264496 response_code = 204 uri = /switch-ports
16002024-05-16T00:49:39.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62091 req_id = 164386d1-29b8-4ebc-aa21-411eb087d1b2 response_code = 200 uri = /network-bootstore-config
16012024-05-16T00:49:39.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58619
16022024-05-16T00:49:39.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 44948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58619 req_id = c70043e6-fef9-46d9-a331-4d6a44861887 response_code = 204 uri = /switch-ports
16032024-05-16T00:49:39.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58619 req_id = 8c1c6f21-cea9-4215-a105-ff8f8e55957c response_code = 200 uri = /network-bootstore-config
16042024-05-16T00:49:39.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62991
16052024-05-16T00:49:39.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 42508 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62991 req_id = 721a2e7c-2ef1-4105-a6c9-f2f11be0a353 response_code = 204 uri = /switch-ports
16062024-05-16T00:49:39.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62991 req_id = 8dd6bd90-5cba-41cc-9a8e-794199257091 response_code = 200 uri = /network-bootstore-config
16072024-05-16T00:49:40.140ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57684
16082024-05-16T00:49:40.140ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57684 req_id = e21408df-ab9b-486c-9ca7-7269ce3058a0 response_code = 200 uri = /baseboard
16092024-05-16T00:49:41.855ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 604 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = fdd36cc5-67a6-40c9-bccf-ffd746f2334c response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
16102024-05-16T00:50:09.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40961
16112024-05-16T00:50:09.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 49256 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40961 req_id = ee20378f-912f-4bd1-9a63-31fe88c226b7 response_code = 204 uri = /switch-ports
16122024-05-16T00:50:09.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40961 req_id = 3275d4d0-d5a6-43a4-95fb-fc2ec4808c8e response_code = 200 uri = /network-bootstore-config
16132024-05-16T00:50:09.783ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37442
16142024-05-16T00:50:09.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 47898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37442 req_id = 273109b7-5329-43d8-b540-bfc54e359d90 response_code = 204 uri = /switch-ports
16152024-05-16T00:50:09.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46954
16162024-05-16T00:50:09.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 3185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37442 req_id = 9e0e9fca-8fb8-4395-8e6b-3678c0b2641d response_code = 200 uri = /network-bootstore-config
16172024-05-16T00:50:09.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46954 req_id = 22ae6410-d418-43f1-ad9a-56d1c5396065 response_code = 204 uri = /switch-ports
16182024-05-16T00:50:09.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46954 req_id = e4484947-88b7-4fb9-9b87-6b0365bddc68 response_code = 200 uri = /network-bootstore-config
16192024-05-16T00:50:10.173ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39313
16202024-05-16T00:50:10.174ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 559 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39313 req_id = 638740d1-832f-47a9-b91a-a4658ea7ad6e response_code = 200 uri = /baseboard
16212024-05-16T00:50:11.856ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 1260 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = 5e97b856-8688-47d1-a67e-5d98e6216a55 response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
16222024-05-16T00:50:39.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54728
16232024-05-16T00:50:39.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 48533 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54728 req_id = bad2bdc3-b2c6-4b0c-9e67-a979d1e73600 response_code = 204 uri = /switch-ports
16242024-05-16T00:50:39.519ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62321
16252024-05-16T00:50:39.523ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 3229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54728 req_id = d281512d-4deb-4ecd-a832-1fd5e0d158d1 response_code = 200 uri = /network-bootstore-config
16262024-05-16T00:50:39.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46977
16272024-05-16T00:50:39.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62321 req_id = af554f83-6c65-422f-9f58-2b8cb694cba3 response_code = 204 uri = /switch-ports
16282024-05-16T00:50:39.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 609 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62321 req_id = fe7bc630-78a8-4c9b-989d-73786b02ea3f response_code = 200 uri = /network-bootstore-config
16292024-05-16T00:50:39.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 69134 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46977 req_id = 1c77c0a2-528b-4250-ae41-f76570e92c56 response_code = 204 uri = /switch-ports
16302024-05-16T00:50:39.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46977 req_id = 266c67f1-2e25-4b82-92a0-aa3acfa1fd65 response_code = 200 uri = /network-bootstore-config
16312024-05-16T00:50:40.206ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48417
16322024-05-16T00:50:40.206ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48417 req_id = fb27ef92-a8e9-47bf-acc7-d50e561ff985 response_code = 200 uri = /baseboard
16332024-05-16T00:50:41.856ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 809 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = a0f2782b-814b-40bd-b6e0-e730ead21b31 response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
16342024-05-16T00:51:09.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48105
16352024-05-16T00:51:09.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 49571 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48105 req_id = 21b454ae-99a6-4b62-a0e6-10b8521b9dda response_code = 204 uri = /switch-ports
16362024-05-16T00:51:09.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48105 req_id = 0c807a3e-3dcf-401b-bea1-f4836a75d67f response_code = 200 uri = /network-bootstore-config
16372024-05-16T00:51:09.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36274
16382024-05-16T00:51:09.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 47694 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36274 req_id = 56813a41-caaa-40cb-a71d-c9ac424a5f70 response_code = 204 uri = /switch-ports
16392024-05-16T00:51:09.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36274 req_id = 83deee47-2335-454e-886d-6ee6bcaaa730 response_code = 200 uri = /network-bootstore-config
16402024-05-16T00:51:09.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36188
16412024-05-16T00:51:09.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 44776 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36188 req_id = 81e44518-d69b-45f2-a4b1-414fc4b7e12d response_code = 204 uri = /switch-ports
16422024-05-16T00:51:09.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36188 req_id = 6a5c51ed-3bc4-4204-84dd-e55d10bf2c2e response_code = 200 uri = /network-bootstore-config
16432024-05-16T00:51:10.239ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62997
16442024-05-16T00:51:10.239ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62997 req_id = 0d89cf0d-911b-4d53-874a-8c041d69f962 response_code = 200 uri = /baseboard
16452024-05-16T00:51:11.868ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = 656dd378-a029-40c4-bf2d-d733571f1fc2 response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
16462024-05-16T00:51:39.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58560
16472024-05-16T00:51:39.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 48590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58560 req_id = ac96f037-a13b-479f-9281-964a10249e0b response_code = 204 uri = /switch-ports
16482024-05-16T00:51:39.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58560 req_id = 49901d46-cd8a-4fa5-8102-dfba9f2d53be response_code = 200 uri = /network-bootstore-config
16492024-05-16T00:51:39.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33655
16502024-05-16T00:51:39.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 46670 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33655 req_id = 6b12b2e7-0a58-4246-9a55-8d38c4d22af1 response_code = 204 uri = /switch-ports
16512024-05-16T00:51:39.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41382
16522024-05-16T00:51:39.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33655 req_id = 732f55b3-af42-424b-8e5f-70f1431113f3 response_code = 200 uri = /network-bootstore-config
16532024-05-16T00:51:39.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45687 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41382 req_id = 38ee68db-570d-4dd8-90ef-3fe153103384 response_code = 204 uri = /switch-ports
16542024-05-16T00:51:39.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41382 req_id = 8ba6fb25-6b90-4258-94b7-c59fa4c9cf26 response_code = 200 uri = /network-bootstore-config
16552024-05-16T00:51:40.270ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59488
16562024-05-16T00:51:40.270ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59488 req_id = 952f5c8f-628f-4be7-bb0e-2b33eec24a2b response_code = 200 uri = /baseboard
16572024-05-16T00:51:40.994ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:300
16582024-05-16T00:51:40.994ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
16592024-05-16T00:51:41.033ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 2165, tv_nsec: 295971583 } time_to_next_cleanup = 599.99999591s
16602024-05-16T00:51:41.909ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 552 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = 64629767-f87b-4a6a-959a-73c695dc22ce response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
16612024-05-16T00:51:54.672ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
16622024-05-16T00:52:09.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34377
16632024-05-16T00:52:09.494ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 407bf9eb-4fe8-4336-ba89-2a02d924feb0, kind: Service { id: 55e42f05-d8aa-4cb2-94c1-93db88708faf }, name: Name("external-dns-55e42f05-d8aa-4cb2-94c1-93db88708faf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 67])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 4463ba03-6579-42ed-9daf-60d5a2bd4034, kind: Service { id: ecc3cc87-d31b-4070-8357-42402a3de4ca }, name: Name("external-dns-ecc3cc87-d31b-4070-8357-42402a3de4ca"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 109])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 38e6570f-f2b9-4258-8316-c9922e7cf2b9, kind: Service { id: 4d1bdec4-0663-468f-bb89-b96fff034657 }, name: Name("nexus-4d1bdec4-0663-468f-bb89-b96fff034657"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a9a4da95-41c7-4399-8d08-a7f8775a4ec2, kind: Service { id: d5d04124-9918-4bce-aa79-2388f6395fc0 }, name: Name("nexus-d5d04124-9918-4bce-aa79-2388f6395fc0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 194])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed5b09fd-ac17-4e3a-8880-cb9a1fe84fd7, kind: Service { id: c199aa4c-85c6-4fda-8438-db73e90a5af3 }, name: Name("nexus-c199aa4c-85c6-4fda-8438-db73e90a5af3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 211])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16642024-05-16T00:52:09.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
16652024-05-16T00:52:09.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16662024-05-16T00:52:09.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16672024-05-16T00:52:09.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16682024-05-16T00:52:09.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16692024-05-16T00:52:09.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16702024-05-16T00:52:09.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34377 req_id = f3ee5a10-249f-4981-aa27-b9e87b2b592e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16712024-05-16T00:52:09.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45648
16722024-05-16T00:52:09.560ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 407bf9eb-4fe8-4336-ba89-2a02d924feb0, kind: Service { id: 55e42f05-d8aa-4cb2-94c1-93db88708faf }, name: Name("external-dns-55e42f05-d8aa-4cb2-94c1-93db88708faf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 67])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 4463ba03-6579-42ed-9daf-60d5a2bd4034, kind: Service { id: ecc3cc87-d31b-4070-8357-42402a3de4ca }, name: Name("external-dns-ecc3cc87-d31b-4070-8357-42402a3de4ca"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 109])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 38e6570f-f2b9-4258-8316-c9922e7cf2b9, kind: Service { id: 4d1bdec4-0663-468f-bb89-b96fff034657 }, name: Name("nexus-4d1bdec4-0663-468f-bb89-b96fff034657"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a9a4da95-41c7-4399-8d08-a7f8775a4ec2, kind: Service { id: d5d04124-9918-4bce-aa79-2388f6395fc0 }, name: Name("nexus-d5d04124-9918-4bce-aa79-2388f6395fc0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 194])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed5b09fd-ac17-4e3a-8880-cb9a1fe84fd7, kind: Service { id: c199aa4c-85c6-4fda-8438-db73e90a5af3 }, name: Name("nexus-c199aa4c-85c6-4fda-8438-db73e90a5af3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 211])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16732024-05-16T00:52:09.560ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
16742024-05-16T00:52:09.560ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16752024-05-16T00:52:09.560ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16762024-05-16T00:52:09.560ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16772024-05-16T00:52:09.560ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16782024-05-16T00:52:09.560ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16792024-05-16T00:52:09.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45648 req_id = 23cd181a-898c-41a6-8dd4-2602b9fe0fdc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16802024-05-16T00:52:09.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65032
16812024-05-16T00:52:09.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 50452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65032 req_id = 4b367081-8983-4d4f-ba1e-76c3e1224691 response_code = 204 uri = /switch-ports
16822024-05-16T00:52:09.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65032 req_id = 3547c090-74d2-4e7e-8001-3b85a4e75331 response_code = 200 uri = /network-bootstore-config
16832024-05-16T00:52:09.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33057
16842024-05-16T00:52:09.736ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:525 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 407bf9eb-4fe8-4336-ba89-2a02d924feb0, kind: Service { id: 55e42f05-d8aa-4cb2-94c1-93db88708faf }, name: Name("external-dns-55e42f05-d8aa-4cb2-94c1-93db88708faf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 67])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 4463ba03-6579-42ed-9daf-60d5a2bd4034, kind: Service { id: ecc3cc87-d31b-4070-8357-42402a3de4ca }, name: Name("external-dns-ecc3cc87-d31b-4070-8357-42402a3de4ca"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 190, 109])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 38e6570f-f2b9-4258-8316-c9922e7cf2b9, kind: Service { id: 4d1bdec4-0663-468f-bb89-b96fff034657 }, name: Name("nexus-4d1bdec4-0663-468f-bb89-b96fff034657"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 158])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: a9a4da95-41c7-4399-8d08-a7f8775a4ec2, kind: Service { id: d5d04124-9918-4bce-aa79-2388f6395fc0 }, name: Name("nexus-d5d04124-9918-4bce-aa79-2388f6395fc0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 138, 194])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ed5b09fd-ac17-4e3a-8880-cb9a1fe84fd7, kind: Service { id: c199aa4c-85c6-4fda-8438-db73e90a5af3 }, name: Name("nexus-c199aa4c-85c6-4fda-8438-db73e90a5af3"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 211])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16852024-05-16T00:52:09.736ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte0" rules = []
16862024-05-16T00:52:09.736ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16872024-05-16T00:52:09.736ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16882024-05-16T00:52:09.736ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16892024-05-16T00:52:09.736ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16902024-05-16T00:52:09.736ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:544 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16912024-05-16T00:52:09.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33057 req_id = eb406ee2-cb3f-4090-8387-d7d43ec01f77 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16922024-05-16T00:52:09.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46272
16932024-05-16T00:52:09.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 48795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46272 req_id = b83693b8-2f8b-4e0b-ad36-5dd4fb71295a response_code = 204 uri = /switch-ports
16942024-05-16T00:52:09.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47767
16952024-05-16T00:52:09.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46272 req_id = 696150b4-189c-4518-96b9-58c91f9b2813 response_code = 200 uri = /network-bootstore-config
16962024-05-16T00:52:09.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 44314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47767 req_id = e04a06ac-cc12-4423-88c6-0885a7b3591b response_code = 204 uri = /switch-ports
16972024-05-16T00:52:09.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 917 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47767 req_id = 99d41c4f-2c29-49e6-8f41-baa6c2582b8a response_code = 200 uri = /network-bootstore-config
16982024-05-16T00:52:10.302ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48529
16992024-05-16T00:52:10.302ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48529 req_id = 0484eaf8-1151-4d87-bc5b-a23cfe8be250 response_code = 200 uri = /baseboard
17002024-05-16T00:52:11.909ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 587 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = b4b71de5-5197-4036-b342-a88f84876780 response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
17012024-05-16T00:52:39.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62267
17022024-05-16T00:52:39.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 46616 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62267 req_id = 5440c4c0-d7c9-4b5b-b1df-17c982f9161a response_code = 204 uri = /switch-ports
17032024-05-16T00:52:39.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62267 req_id = c5e2111f-8376-4283-a0eb-71311b6860a1 response_code = 200 uri = /network-bootstore-config
17042024-05-16T00:52:39.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37317
17052024-05-16T00:52:39.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 47842 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37317 req_id = b44d34cb-25ba-41da-9853-defb5fcd9d5a response_code = 204 uri = /switch-ports
17062024-05-16T00:52:39.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37317 req_id = fef09355-2459-46db-92ab-ba2a40aa8340 response_code = 200 uri = /network-bootstore-config
17072024-05-16T00:52:39.635ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46957
17082024-05-16T00:52:39.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 42340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46957 req_id = 0216dea6-d5ad-4a4d-b463-ada3b4529e83 response_code = 204 uri = /switch-ports
17092024-05-16T00:52:39.678ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46957 req_id = 8f70722c-f355-4a82-a0f1-1feb3d07353e response_code = 200 uri = /network-bootstore-config
17102024-05-16T00:52:40.334ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48607
17112024-05-16T00:52:40.335ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 844 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48607 req_id = 7fd4c7cc-0d63-42ba-ba51-3f274d0e82dd response_code = 200 uri = /baseboard
17122024-05-16T00:52:41.910ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 986 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = ddb4061b-dbca-4a31-b34e-491de3ca64a1 response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
17132024-05-16T00:53:09.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59651
17142024-05-16T00:53:09.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45826 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59651 req_id = f8ca587d-dade-41b4-b082-144e64319de2 response_code = 204 uri = /switch-ports
17152024-05-16T00:53:09.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55042
17162024-05-16T00:53:09.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 3687 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59651 req_id = 7e1a92db-aa28-4690-9a3c-53056fff4a9d response_code = 200 uri = /network-bootstore-config
17172024-05-16T00:53:09.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45723 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55042 req_id = 028296da-e9b2-4979-a18c-1c4c8c14666d response_code = 204 uri = /switch-ports
17182024-05-16T00:53:09.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55042 req_id = 52f9781a-39f6-4bcc-912e-d12047e0dc15 response_code = 200 uri = /network-bootstore-config
17192024-05-16T00:53:09.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37464
17202024-05-16T00:53:09.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45436 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37464 req_id = 4bf21a38-be42-4d6b-876e-43f928f4c595 response_code = 204 uri = /switch-ports
17212024-05-16T00:53:09.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37464 req_id = 60d09782-f15c-4310-a892-2bfa7e5f074b response_code = 200 uri = /network-bootstore-config
17222024-05-16T00:53:10.367ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60746
17232024-05-16T00:53:10.367ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60746 req_id = 24a7a4dd-1879-4254-ba22-6f07249b59ee response_code = 200 uri = /baseboard
17242024-05-16T00:53:11.910ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 1240 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = 07f6aa14-f101-4058-a903-a1dc29a6e020 response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
17252024-05-16T00:53:39.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62992
17262024-05-16T00:53:39.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 44640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62992 req_id = 7fadfc72-43ea-4837-a0a3-9b016764907b response_code = 204 uri = /switch-ports
17272024-05-16T00:53:39.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 708 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62992 req_id = ea934246-bea2-4b47-a0f6-f77bc90fb92a response_code = 200 uri = /network-bootstore-config
17282024-05-16T00:53:39.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45680
17292024-05-16T00:53:39.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45680 req_id = 1f931fb8-32a0-41c8-b7b6-8d5e66805d51 response_code = 204 uri = /switch-ports
17302024-05-16T00:53:39.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45680 req_id = 4689af47-2ff3-400d-a4e6-db55007e26cd response_code = 200 uri = /network-bootstore-config
17312024-05-16T00:53:39.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36281
17322024-05-16T00:53:39.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 43457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36281 req_id = 4d4d981f-fc60-49e0-8f8e-483d89f11e23 response_code = 204 uri = /switch-ports
17332024-05-16T00:53:39.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 662 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36281 req_id = 6add7582-9a8b-4825-b980-a9248b88ce6d response_code = 200 uri = /network-bootstore-config
17342024-05-16T00:53:40.398ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50653
17352024-05-16T00:53:40.398ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 84 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50653 req_id = 1e5ee1d4-1356-4e81-9d86-dc682335b395 response_code = 200 uri = /baseboard
17362024-05-16T00:53:41.909ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 600 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = f369d953-024d-4fe4-a79f-b3251f219999 response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb
17372024-05-16T00:53:50.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46027
17382024-05-16T00:53:50.507ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:546 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e09cfba3-fdac-42fb-88dc-48644074adaf, kind: Instance { id: 833e29f1-dbf2-441e-9c40-c23e6a74bbad }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 220, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(8942171), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e09cfba3-fdac-42fb-88dc-48644074adaf, kind: Instance { id: 833e29f1-dbf2-441e-9c40-c23e6a74bbad }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 220, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(8942171), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e09cfba3-fdac-42fb-88dc-48644074adaf, kind: Instance { id: 833e29f1-dbf2-441e-9c40-c23e6a74bbad }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 220, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(8942171), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(8942171))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e09cfba3-fdac-42fb-88dc-48644074adaf, kind: Instance { id: 833e29f1-dbf2-441e-9c40-c23e6a74bbad }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 220, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(8942171), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-8faf0db7fbc", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 1bb92efb-407a-40d1-998f-8fa526db55b3, read_only_parent: Some(Volume { block_size: 512, id: 56d12380-aca1-4e11-8ec4-eb8cb497faa4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1ef6ad2d-2def-4012-a618-997503831994, key: Some("MZgbVske4lu6Vq1LgHiW+zCTOy6o4yvvlgZLheoAZQk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1bb92efb-407a-40d1-998f-8fa526db55b3, key: Some("iRNFcJEanMb+ZYdxxjfRoNHqb7kjgb+vEsUXSweKB+k="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::18]:19002"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAtuQawWLBYAAC5BrBYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAALrkGsFiwWAAAuQawWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI4MzNlMjlmMS1kYmYyLTQ0MWUtOWM0MC1jMjNlNmE3NGJiYWQiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQ1liWmdzdWtucGYxUDFGYmZ3Q3Nza1N6UUY3WG1DMUZEa2ptcVE2ZVhobyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad instance_runtime = InstanceRuntimeState { propolis_id: Some(57f38f02-ed13-4f57-a292-4b5d2a862e5f), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-16T00:53:49.999578303Z } metadata = InstanceMetadata { silo_id: 26c9b689-dcbe-4b6d-b4d7-c02a85fa2d7e, project_id: 83122f2d-45cc-48c8-becd-054854200f95 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 57f38f02-ed13-4f57-a292-4b5d2a862e5f vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-05-16T00:53:49.936543Z }
17392024-05-16T00:53:50.508ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:580 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17402024-05-16T00:53:50.508ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:938 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad propolis_id = 57f38f02-ed13-4f57-a292-4b5d2a862e5f state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: e09cfba3-fdac-42fb-88dc-48644074adaf, kind: Instance { id: 833e29f1-dbf2-441e-9c40-c23e6a74bbad }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 220, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(8942171), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e09cfba3-fdac-42fb-88dc-48644074adaf, kind: Instance { id: 833e29f1-dbf2-441e-9c40-c23e6a74bbad }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 220, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(8942171), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e09cfba3-fdac-42fb-88dc-48644074adaf, kind: Instance { id: 833e29f1-dbf2-441e-9c40-c23e6a74bbad }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 220, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(8942171), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(8942171))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: e09cfba3-fdac-42fb-88dc-48644074adaf, kind: Instance { id: 833e29f1-dbf2-441e-9c40-c23e6a74bbad }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 249, 220, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(8942171), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-8faf0db7fbc", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 1bb92efb-407a-40d1-998f-8fa526db55b3, read_only_parent: Some(Volume { block_size: 512, id: 56d12380-aca1-4e11-8ec4-eb8cb497faa4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1ef6ad2d-2def-4012-a618-997503831994, key: Some("MZgbVske4lu6Vq1LgHiW+zCTOy6o4yvvlgZLheoAZQk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1bb92efb-407a-40d1-998f-8fa526db55b3, key: Some("iRNFcJEanMb+ZYdxxjfRoNHqb7kjgb+vEsUXSweKB+k="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::18]:19002"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAtuQawWLBYAAC5BrBYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAALrkGsFiwWAAAuQawWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI4MzNlMjlmMS1kYmYyLTQ0MWUtOWM0MC1jMjNlNmE3NGJiYWQiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQ1liWmdzdWtucGYxUDFGYmZ3Q3Nza1N6UUY3WG1DMUZEa2ptcVE2ZVhobyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(57f38f02-ed13-4f57-a292-4b5d2a862e5f), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-16T00:53:49.999578303Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-05-16T00:53:49.936543Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
17412024-05-16T00:53:50.509ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 8118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46027 req_id = 001bf893-5414-4f73-8a35-1ca23c4473ba response_code = 200 uri = /instances/833e29f1-dbf2-441e-9c40-c23e6a74bbad
17422024-05-16T00:53:50.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52994
17432024-05-16T00:53:50.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 7038 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52994 req_id = 2db09118-41fa-446c-91dd-f8ddbc3998f3 response_code = 200 uri = /instances/833e29f1-dbf2-441e-9c40-c23e6a74bbad/state
17442024-05-16T00:53:50.680ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:394 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 249, 220, 74]), slot: 0, vni: Vni { inner: 8942171 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
17452024-05-16T00:53:50.681ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17462024-05-16T00:53:50.714ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f file = illumos-utils/src/zone.rs:315 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17472024-05-16T00:53:50.734ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f file = illumos-utils/src/zone.rs:354 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17482024-05-16T00:53:52.274ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::a]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17492024-05-16T00:53:52.275ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad zone = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17502024-05-16T00:53:52.454ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 30.461289ms file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad zone = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17512024-05-16T00:53:52.493ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 51.292424ms file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad zone = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17522024-05-16T00:53:52.559ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 214.066785ms file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad zone = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17532024-05-16T00:53:52.789ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 466.924745ms file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad zone = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17542024-05-16T00:53:53.271ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 925.215784ms file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad zone = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17552024-05-16T00:53:54.207ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 1.329750512s file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad zone = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17562024-05-16T00:53:55.547ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 1.258173917s file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad zone = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17572024-05-16T00:53:56.816ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 1.239217604s file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad zone = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17582024-05-16T00:53:58.083ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f file = sled-agent/src/instance.rs:1423 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17592024-05-16T00:53:58.092ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 52.265112ms file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17602024-05-16T00:53:58.155ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 90.917982ms file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17612024-05-16T00:53:58.258ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f") failed: Property not found. retry in 227.626498ms file = illumos-utils/src/svc.rs:36 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17622024-05-16T00:53:58.498ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1432 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17632024-05-16T00:53:58.540ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1446 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17642024-05-16T00:53:58.541ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAtuQawWLBYAAC5BrBYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAALrkGsFiwWAAAuQawWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI4MzNlMjlmMS1kYmYyLTQ0MWUtOWM0MC1jMjNlNmE3NGJiYWQiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQ1liWmdzdWtucGYxUDFGYmZ3Q3Nza1N6UUY3WG1DMUZEa2ptcVE2ZVhobyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-8faf0db7fbc", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 1bb92efb-407a-40d1-998f-8fa526db55b3, read_only_parent: Some(Volume { block_size: 512, id: 56d12380-aca1-4e11-8ec4-eb8cb497faa4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1ef6ad2d-2def-4012-a618-997503831994, key: Some("MZgbVske4lu6Vq1LgHiW+zCTOy6o4yvvlgZLheoAZQk="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::13]:19001", "[fd00:1122:3344:101::18]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1bb92efb-407a-40d1-998f-8fa526db55b3, key: Some("iRNFcJEanMb+ZYdxxjfRoNHqb7kjgb+vEsUXSweKB+k="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::18]:19002"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: 833e29f1-dbf2-441e-9c40-c23e6a74bbad, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 83122f2d-45cc-48c8-becd-054854200f95, silo_id: 26c9b689-dcbe-4b6d-b4d7-c02a85fa2d7e }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:685 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17652024-05-16T00:53:58.719ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:687 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17662024-05-16T00:53:58.720ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-05-16T00:53:58.720399327Z } file = sled-agent/src/instance.rs:569 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17672024-05-16T00:53:58.720ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad new_instance_state = InstanceRuntimeState { propolis_id: Some(57f38f02-ed13-4f57-a292-4b5d2a862e5f), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-16T00:53:49.999578303Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-05-16T00:53:58.720399327Z } propolis_id = 57f38f02-ed13-4f57-a292-4b5d2a862e5f
17682024-05-16T00:53:58.720ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(57f38f02-ed13-4f57-a292-4b5d2a862e5f), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-16T00:53:49.999578303Z }, propolis_id: 57f38f02-ed13-4f57-a292-4b5d2a862e5f, vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-05-16T00:53:58.720399327Z } }
17692024-05-16T00:53:58.802ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-05-16T00:53:58.802556589Z } file = sled-agent/src/instance.rs:569 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17702024-05-16T00:53:58.802ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad new_instance_state = InstanceRuntimeState { propolis_id: Some(57f38f02-ed13-4f57-a292-4b5d2a862e5f), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-16T00:53:49.999578303Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-05-16T00:53:58.802556589Z } propolis_id = 57f38f02-ed13-4f57-a292-4b5d2a862e5f
17712024-05-16T00:53:58.802ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(57f38f02-ed13-4f57-a292-4b5d2a862e5f), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-16T00:53:49.999578303Z }, propolis_id: 57f38f02-ed13-4f57-a292-4b5d2a862e5f, vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-05-16T00:53:58.802556589Z } }
17722024-05-16T00:54:08.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39811
17732024-05-16T00:54:08.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 608 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39811 req_id = c0f27c07-0634-49bd-95fd-1a38f4e91354 response_code = 200 uri = /instances/833e29f1-dbf2-441e-9c40-c23e6a74bbad/state
17742024-05-16T00:54:08.168ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-05-16T00:54:08.168322673Z } file = sled-agent/src/instance.rs:569 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17752024-05-16T00:54:08.168ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad new_instance_state = InstanceRuntimeState { propolis_id: Some(57f38f02-ed13-4f57-a292-4b5d2a862e5f), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-16T00:53:49.999578303Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-05-16T00:54:08.168322673Z } propolis_id = 57f38f02-ed13-4f57-a292-4b5d2a862e5f
17762024-05-16T00:54:08.168ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(57f38f02-ed13-4f57-a292-4b5d2a862e5f), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-16T00:53:49.999578303Z }, propolis_id: 57f38f02-ed13-4f57-a292-4b5d2a862e5f, vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-05-16T00:54:08.168322673Z } }
17772024-05-16T00:54:08.195ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-05-16T00:54:08.195947966Z } file = sled-agent/src/instance.rs:569 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17782024-05-16T00:54:08.196ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-16T00:54:08.195947966Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-05-16T00:54:08.195947966Z } propolis_id = 57f38f02-ed13-4f57-a292-4b5d2a862e5f
17792024-05-16T00:54:08.196ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:606 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17802024-05-16T00:54:08.196ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17812024-05-16T00:54:08.196ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17822024-05-16T00:54:08.196ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/63e463e5-47a1-42e8-8499-7e0d4be1fc32/debug/bundle/zone", "/pool/int/93a5c4e6-bb36-444e-b14f-9a0c92e047b4/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/aee2f8e5-ad05-48a0-89c1-d42f21fddf5a/crypt/debug", "/pool/ext/2ca53e61-8a62-423d-bd09-0f828836f86b/crypt/debug", "/pool/ext/a5fef5bb-8d3d-4e12-8b17-1b7f0968cb81/crypt/debug", "/pool/ext/e4892d21-b561-4f79-8b36-35f2ad012b54/crypt/debug", "/pool/ext/76f4c53b-96f2-4a50-a841-163cf47f5db0/crypt/debug", "/pool/ext/a257a7eb-942f-4c01-b851-a8222ad60649/crypt/debug", "/pool/ext/45089a3d-a9b7-44c7-aa98-3f45b63d8292/crypt/debug", "/pool/ext/23cf064d-a4cd-4feb-84b2-17213c849d5e/crypt/debug", "/pool/ext/9f55bff5-f174-4d84-8f88-80c856df8730/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f
17832024-05-16T00:54:08.851ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f", bundle_id: fead4e60-4dc2-4bb4-9a4b-8b07a926cae6 }, time_created: 2024-05-16T00:54:08.196688354Z, version: 0, cause: TerminatedInstance }
17842024-05-16T00:54:08.851ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_57f38f02-ed13-4f57-a292-4b5d2a862e5f file = sled-agent/src/instance.rs:780 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
17852024-05-16T00:54:09.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40602
17862024-05-16T00:54:09.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33404
17872024-05-16T00:54:09.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37897
17882024-05-16T00:54:09.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 50385 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37897 req_id = 1ae59d72-1c7c-48bb-bb9a-b2e8cd5c8e79 response_code = 204 uri = /switch-ports
17892024-05-16T00:54:09.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45754
17902024-05-16T00:54:09.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37897 req_id = d32b5b25-c19a-4006-9e47-570425c3d30e response_code = 200 uri = /network-bootstore-config
17912024-05-16T00:54:09.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44633
17922024-05-16T00:54:09.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 45949 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44633 req_id = 83b269e0-e61c-4a85-9395-57c88f503da9 response_code = 204 uri = /switch-ports
17932024-05-16T00:54:09.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44633 req_id = 36665477-f65a-4d02-a557-73a49bb1513f response_code = 200 uri = /network-bootstore-config
17942024-05-16T00:54:10.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36366
17952024-05-16T00:54:10.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 55526 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36366 req_id = b7c61419-fee2-4d2a-b6b7-03d141be7a76 response_code = 204 uri = /switch-ports
17962024-05-16T00:54:10.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36366 req_id = 094808e5-014f-448d-bdd5-01581b41dfac response_code = 200 uri = /network-bootstore-config
17972024-05-16T00:54:10.432ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61735
17982024-05-16T00:54:10.432ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 118 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61735 req_id = 89cf4499-b349-4a24-a5c7-dcfea4781bd8 response_code = 200 uri = /baseboard
17992024-05-16T00:54:10.689ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
18002024-05-16T00:54:10.715ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-16T00:54:08.195947966Z }, propolis_id: 57f38f02-ed13-4f57-a292-4b5d2a862e5f, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-05-16T00:54:10.715748994Z } }
18012024-05-16T00:54:10.814ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56781
18022024-05-16T00:54:10.815ZWARNSledAgent (PortManager): unset_virtual_nic_host unimplmented file = illumos-utils/src/opte/port_manager.rs:620
18032024-05-16T00:54:10.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 897 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:56781 req_id = 02c45141-1e2c-4559-8e6d-dc7b207d5c56 response_code = 204 uri = /v2p/e09cfba3-fdac-42fb-88dc-48644074adaf
18042024-05-16T00:54:11.113ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-16T00:54:08.195947966Z }, propolis_id: 57f38f02-ed13-4f57-a292-4b5d2a862e5f, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-05-16T00:54:10.715748994Z } }
18052024-05-16T00:54:11.116ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:723 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
18062024-05-16T00:54:11.147ZERROSledAgent (InstanceManager): Failed to publish state to Nexus, will not retry: Notification(Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f9517749-4bfb-4a28-b39c-17682861d78d", "content-length": "177", "date": "Thu, 16 May 2024 00:54:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: instance with id \"833e29f1-dbf2-441e-9c40-c23e6a74bbad\"", request_id: "f9517749-4bfb-4a28-b39c-17682861d78d" }) file = sled-agent/src/instance.rs:555 instance_id = 833e29f1-dbf2-441e-9c40-c23e6a74bbad
18072024-05-16T00:54:11.150ZWARNSledAgent (InstanceManager): Error handling request err = Instance(RequestDropped(RecvError(()))) file = sled-agent/src/instance_manager.rs:502 request = GetState
18082024-05-16T00:54:11.150ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Not Found error_message_internal = No such instance ID: 833e29f1-dbf2-441e-9c40-c23e6a74bbad file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 1440246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45754 req_id = 2de06a64-ce63-4137-91ab-33dea8f438f0 response_code = 404 uri = /instances/833e29f1-dbf2-441e-9c40-c23e6a74bbad/state
18092024-05-16T00:54:11.150ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Error managing instances: Instance Manager dropped our request file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 1706960 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40602 req_id = eed5cd76-bf83-422d-8a20-c3e55ecc0e2b response_code = 500 uri = /instances/833e29f1-dbf2-441e-9c40-c23e6a74bbad/state
18102024-05-16T00:54:11.150ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Not Found error_message_internal = No such instance ID: 833e29f1-dbf2-441e-9c40-c23e6a74bbad file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:866 latency_us = 1628602 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33404 req_id = 6def184e-9c46-4a3a-a804-4e05089a4bad response_code = 404 uri = /instances/833e29f1-dbf2-441e-9c40-c23e6a74bbad/state
18112024-05-16T00:54:12.044ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/283d897/dropshot/src/server.rs:878 latency_us = 562 local_addr = [fd00:1122:3344:101::1]:37133 method = GET remote_addr = [fd00:1122:3344:101::d]:39143 req_id = 8619b2dd-5e51-4da2-8ff6-8c339c8979a1 response_code = 200 sled_id = ebcdcaed-e48b-4070-ab17-779f5ea072cb uri = /ebcdcaed-e48b-4070-ab17-779f5ea072cb