Max level shown:
1 [ Jun 25 07:05:16 Enabled. ]
2 [ Jun 25 07:05:16 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jun 25 07:05:16 Method "start" exited with status 0. ]
4 [ Jun 25 07:05:16 Rereading configuration. ]
5 [ Jun 25 07:05:16 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-06-25T07:05:16.964ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-06-25T07:05:16.964ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-06-25T07:05:17.016ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-06-25T07:05:17.016ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-06-25T07:05:17.129ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-06-25T07:05:17.139ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-06-25T07:05:17.147ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-06-25T07:05:17.747ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:9fb2::, len: 64 }
152024-06-25T07:05:17.886ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-06-25T07:05:17.886ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-06-25T07:05:17.886ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-06-25T07:05:17.886ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-06-25T07:05:17.886ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:506
202024-06-25T07:05:17.886ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:625
212024-06-25T07:05:17.889ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
222024-06-25T07:05:17.889ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:674
232024-06-25T07:05:17.889ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242024-06-25T07:05:17.889ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:733
252024-06-25T07:05:17.889ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
262024-06-25T07:05:17.889ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = None
272024-06-25T07:05:17.889ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
282024-06-25T07:05:17.889ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-06-25T07:05:17.889ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-06-25T07:05:17.901ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:304
312024-06-25T07:05:17.901ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool)
322024-06-25T07:05:18.000ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal }
332024-06-25T07:05:18.203ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
342024-06-25T07:05:18.203ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
352024-06-25T07:05:18.203ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-06-25T07:05:18.203ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-06-25T07:05:18.203ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
382024-06-25T07:05:18.203ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-06-25T07:05:18.203ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-06-25T07:05:18.211ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:304
412024-06-25T07:05:18.211ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool)
422024-06-25T07:05:18.297ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal }
432024-06-25T07:05:18.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
442024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
452024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
462024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
472024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
482024-06-25T07:05:18.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-06-25T07:05:18.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
502024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
512024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
522024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
532024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-06-25T07:05:18.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-06-25T07:05:18.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
562024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
572024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
582024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
592024-06-25T07:05:18.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
602024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
612024-06-25T07:05:18.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
622024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
632024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
642024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
652024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
662024-06-25T07:05:18.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-06-25T07:05:18.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
682024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
692024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
702024-06-25T07:05:18.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
722024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
732024-06-25T07:05:18.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
742024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
752024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
762024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
772024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
782024-06-25T07:05:18.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792024-06-25T07:05:18.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
802024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
812024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
822024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
832024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
842024-06-25T07:05:18.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-06-25T07:05:18.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
862024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
872024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
882024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
892024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
902024-06-25T07:05:18.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-06-25T07:05:18.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
922024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
932024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
942024-06-25T07:05:18.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
962024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
972024-06-25T07:05:18.495ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
982024-06-25T07:05:18.495ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:93
992024-06-25T07:05:18.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
1002024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1012024-06-25T07:05:18.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1022024-06-25T07:05:18.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1032024-06-25T07:05:18.495ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
1042024-06-25T07:05:18.495ZINFOSledAgent (bootstore): No ledger in /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-06-25T07:05:18.495ZINFOSledAgent (bootstore): No ledger in /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-06-25T07:05:18.495ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-06-25T07:05:18.495ZINFOSledAgent (bootstore): No ledger in /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-06-25T07:05:18.495ZINFOSledAgent (bootstore): No ledger in /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-06-25T07:05:18.495ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-06-25T07:05:18.495ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
1112024-06-25T07:05:18.495ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
1122024-06-25T07:05:18.506ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:710
1132024-06-25T07:05:18.506ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 2047, tv_nsec: 668529957 } time_to_next_cleanup = 599.999936848s
1142024-06-25T07:05:18.506ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3547
1152024-06-25T07:05:18.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1162024-06-25T07:05:18.506ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-06-25T07:05:18.509ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-06-25T07:05:18.509ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-06-25T07:05:18.509ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-06-25T07:05:18.510ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1011
1212024-06-25T07:05:18.510ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-06-25T07:05:18.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1232024-06-25T07:05:18.510ZINFOSledAgent (RSS): No ledger in /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-06-25T07:05:18.510ZINFOSledAgent (RSS): No ledger in /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-06-25T07:05:18.510ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1071
1262024-06-25T07:05:18.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1272024-06-25T07:05:18.510ZINFOSledAgent (RSS): No ledger in /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-06-25T07:05:18.510ZINFOSledAgent (RSS): No ledger in /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-06-25T07:05:18.510ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1112
1302024-06-25T07:05:18.510ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-06-25T07:05:18.510ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-06-25T07:05:18.510ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1332024-06-25T07:05:18.510ZINFOSledAgent (RSS): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-06-25T07:05:18.510ZINFOSledAgent (RSS): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-06-25T07:05:18.510ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-06-25T07:05:18.510ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1145
1372024-06-25T07:05:18.510ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-06-25T07:05:18.510ZINFOSledAgent (bootstore): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-06-25T07:05:18.510ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-06-25T07:05:18.511ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-06-25T07:05:18.511ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 6ec53d70-2eff-4360-abaf-e88d5a5744b1, rack_id: c4040e58-1f95-4f0d-87ab-a992aa58e92b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-06-25T07:05:18.511ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:35958
1432024-06-25T07:05:18.511ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 6ec53d70-2eff-4360-abaf-e88d5a5744b1, rack_id: c4040e58-1f95-4f0d-87ab-a992aa58e92b, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:360
1442024-06-25T07:05:18.511ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1452024-06-25T07:05:18.511ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1462024-06-25T07:05:18.511ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1472024-06-25T07:05:18.511ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1482024-06-25T07:05:18.511ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1492024-06-25T07:05:18.511ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1502024-06-25T07:05:18.511ZINFOSledAgent (StorageManager): No ledger in /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1512024-06-25T07:05:18.511ZINFOSledAgent (StorageManager): No ledger in /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-06-25T07:05:18.511ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1532024-06-25T07:05:18.511ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1542024-06-25T07:05:18.513ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3779
1552024-06-25T07:05:18.522ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
1562024-06-25T07:05:18.532ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
1572024-06-25T07:05:18.542ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
1582024-06-25T07:05:18.550ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
1592024-06-25T07:05:18.559ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
1602024-06-25T07:05:18.568ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
1612024-06-25T07:05:18.576ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
1622024-06-25T07:05:18.585ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
1632024-06-25T07:05:18.593ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
1642024-06-25T07:05:18.593ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1652024-06-25T07:05:18.593ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1662024-06-25T07:05:18.593ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1672024-06-25T07:05:18.593ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1682024-06-25T07:05:18.593ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1692024-06-25T07:05:18.614ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1702024-06-25T07:05:18.631ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1712024-06-25T07:05:18.650ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:354 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
1722024-06-25T07:05:18.650ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1732024-06-25T07:05:18.650ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:366 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
1742024-06-25T07:05:18.650ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1752024-06-25T07:05:18.653ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 126.875892ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b37b5b6d-1d37-4182-9fe2-9f6dcc4ae1c8", "content-length": "124", "date": "Tue, 25 Jun 2024 07:05:17 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b37b5b6d-1d37-4182-9fe2-9f6dcc4ae1c8" } file = clients/ddm-admin-client/src/lib.rs:178
1762024-06-25T07:05:18.664ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_97ed7846-dc54-4083-af8f-8638d77ed528/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1772024-06-25T07:05:18.688ZINFOSledAgent: successfully created encrypted zvol: name="oxi_97ed7846-dc54-4083-af8f-8638d77ed528/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-06-25T07:05:18.688ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_97ed7846-dc54-4083-af8f-8638d77ed528/swap" file = sled-agent/src/swap_device.rs:96
1792024-06-25T07:05:18.694ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:381 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
1802024-06-25T07:05:18.694ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1812024-06-25T07:05:18.694ZINFOSledAgent (BackingFs): Ensuring dataset oxi_97ed7846-dc54-4083-af8f-8638d77ed528/backing/fmd file = sled-agent/src/backing_fs.rs:136
1822024-06-25T07:05:18.767ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1832024-06-25T07:05:18.780ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1842024-06-25T07:05:18.781ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 77.273197ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d391a90f-9aa0-4bf1-a6a4-1897cb396364", "content-length": "124", "date": "Tue, 25 Jun 2024 07:05:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d391a90f-9aa0-4bf1-a6a4-1897cb396364" } file = clients/ddm-admin-client/src/lib.rs:178
1852024-06-25T07:05:18.859ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1862024-06-25T07:05:18.860ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 199.599132ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1fd16116-bcf5-4f65-84e4-5ee1aaa001c3", "content-length": "124", "date": "Tue, 25 Jun 2024 07:05:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1fd16116-bcf5-4f65-84e4-5ee1aaa001c3" } file = clients/ddm-admin-client/src/lib.rs:178
1872024-06-25T07:05:18.986ZINFOSledAgent (BackingFs): Mounting oxi_97ed7846-dc54-4083-af8f-8638d77ed528/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1882024-06-25T07:05:18.999ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1892024-06-25T07:05:18.999ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1902024-06-25T07:05:18.999ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1912024-06-25T07:05:18.999ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1922024-06-25T07:05:19.061ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1932024-06-25T07:05:19.061ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 172.66375ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "90ebd53e-624c-4ab8-b3f5-a50552a7b256", "content-length": "124", "date": "Tue, 25 Jun 2024 07:05:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "90ebd53e-624c-4ab8-b3f5-a50552a7b256" } file = clients/ddm-admin-client/src/lib.rs:178
1942024-06-25T07:05:19.236ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1952024-06-25T07:05:19.236ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 236.655919ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f09b7c87-3e4a-4c86-b7b4-c11846dfb432", "content-length": "124", "date": "Tue, 25 Jun 2024 07:05:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f09b7c87-3e4a-4c86-b7b4-c11846dfb432" } file = clients/ddm-admin-client/src/lib.rs:178
1962024-06-25T07:05:19.474ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1972024-06-25T07:05:19.475ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 307.763998ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "588da41a-23bd-4ddd-9d43-c444824d2429", "content-length": "124", "date": "Tue, 25 Jun 2024 07:05:18 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "588da41a-23bd-4ddd-9d43-c444824d2429" } file = clients/ddm-admin-client/src/lib.rs:178
1982024-06-25T07:05:19.719ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
1992024-06-25T07:05:19.720ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:34584 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2002024-06-25T07:05:19.720ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2012024-06-25T07:05:19.720ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:34584 file = oximeter/producer/src/lib.rs:282 interval = 30s producer_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2022024-06-25T07:05:19.722ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 297.600558ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2032024-06-25T07:05:19.767ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2042024-06-25T07:05:19.767ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2052024-06-25T07:05:19.767ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:893 underlay_address = fd00:1122:3344:101::1
2062024-06-25T07:05:19.767ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2072024-06-25T07:05:19.768ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:12345
2082024-06-25T07:05:19.768ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
2092024-06-25T07:05:19.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2102024-06-25T07:05:19.768ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2112024-06-25T07:05:19.768ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2122024-06-25T07:05:19.768ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2132024-06-25T07:05:19.768ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:35958
2142024-06-25T07:05:19.768ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2152024-06-25T07:05:19.768ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3547
2162024-06-25T07:05:19.769ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2172024-06-25T07:05:19.769ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2182024-06-25T07:05:19.990ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
2192024-06-25T07:05:19.991ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2202024-06-25T07:05:19.991ZINFOSledAgent (RSS): No ledger in /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2212024-06-25T07:05:19.992ZINFOSledAgent (RSS): No ledger in /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2222024-06-25T07:05:19.992ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2232024-06-25T07:05:19.992ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2242024-06-25T07:05:19.997ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2252024-06-25T07:05:20.021ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 703.244179ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2262024-06-25T07:05:20.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60449
2272024-06-25T07:05:20.025ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2282024-06-25T07:05:20.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60449 req_id = 2f99485a-f4c4-4924-8eff-6a74ff17faba response_code = 200 uri = /inventory
2292024-06-25T07:05:20.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51260
2302024-06-25T07:05:20.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51260 req_id = a2feca90-ae17-4bea-bb3b-1e327059414e response_code = 200 uri = /sled-role
2312024-06-25T07:05:20.062ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2322024-06-25T07:05:20.062ZINFOSledAgent (RSS): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2332024-06-25T07:05:20.062ZINFOSledAgent (RSS): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2342024-06-25T07:05:20.062ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:812
2352024-06-25T07:05:20.093ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: 477f910e-a70c-47e8-a1cb-3a27cd6372cb, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, pool_id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool) }, OmicronPhysicalDiskConfig { id: 235a64f4-938b-47cc-9aba-fa789ad4c569, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, pool_id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool) }, OmicronPhysicalDiskConfig { id: 3ee9fd27-ec1e-4b98-a329-4ade497d32d0, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, pool_id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool) }, OmicronPhysicalDiskConfig { id: bc71b4ac-6949-46b6-8da6-dbe6c713be79, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, pool_id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool) }, OmicronPhysicalDiskConfig { id: 34afb720-0d07-43f1-ad07-e30a30b8b4e8, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, pool_id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool) }, OmicronPhysicalDiskConfig { id: 01f334f4-9edc-4031-8682-98591014f963, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, pool_id: eba9a72e-79ea-4722-8854-b5f41ec1c20b (zpool) }, OmicronPhysicalDiskConfig { id: ad4b3f1d-a8d2-405b-92d7-639368060ac8, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, pool_id: 44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf (zpool) }, OmicronPhysicalDiskConfig { id: 5a9b04be-f2a6-4b60-9f06-cd513e107cdf, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, pool_id: 6c00033c-63f1-47a0-8b42-6f61b082d646 (zpool) }, OmicronPhysicalDiskConfig { id: 2eb86d84-1e45-4ecf-976e-e8e211dde249, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, pool_id: 6897e83c-187d-4573-a81f-bb7d6f202eb3 (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:348 sled_address = [fd00:1122:3344:101::1]:12345
2362024-06-25T07:05:20.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36278
2372024-06-25T07:05:20.094ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 477f910e-a70c-47e8-a1cb-3a27cd6372cb, pool_id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 235a64f4-938b-47cc-9aba-fa789ad4c569, pool_id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 3ee9fd27-ec1e-4b98-a329-4ade497d32d0, pool_id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: bc71b4ac-6949-46b6-8da6-dbe6c713be79, pool_id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 34afb720-0d07-43f1-ad07-e30a30b8b4e8, pool_id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 01f334f4-9edc-4031-8682-98591014f963, pool_id: eba9a72e-79ea-4722-8854-b5f41ec1c20b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: ad4b3f1d-a8d2-405b-92d7-639368060ac8, pool_id: 44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 5a9b04be-f2a6-4b60-9f06-cd513e107cdf, pool_id: 6c00033c-63f1-47a0-8b42-6f61b082d646 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 2eb86d84-1e45-4ecf-976e-e8e211dde249, pool_id: 6897e83c-187d-4573-a81f-bb7d6f202eb3 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:381
2382024-06-25T07:05:20.094ZINFOSledAgent (StorageManager): No ledger in /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2392024-06-25T07:05:20.094ZINFOSledAgent (StorageManager): No ledger in /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2402024-06-25T07:05:20.094ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2412024-06-25T07:05:20.094ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2422024-06-25T07:05:20.094ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:379
2432024-06-25T07:05:20.094ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2442024-06-25T07:05:20.094ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2452024-06-25T07:05:20.202ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:304
2462024-06-25T07:05:20.202ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool)
2472024-06-25T07:05:20.863ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.104691659s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2482024-06-25T07:05:20.863ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2492024-06-25T07:05:21.274ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }
2502024-06-25T07:05:21.470ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:332
2512024-06-25T07:05:21.470ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:334
2522024-06-25T07:05:21.470ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:338
2532024-06-25T07:05:21.470ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:340
2542024-06-25T07:05:21.470ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2552024-06-25T07:05:21.470ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2562024-06-25T07:05:21.470ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2572024-06-25T07:05:21.875ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2582024-06-25T07:05:22.319ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.584243965s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2592024-06-25T07:05:22.319ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2602024-06-25T07:05:22.319ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2612024-06-25T07:05:22.545ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2622024-06-25T07:05:22.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 64.921882ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2632024-06-25T07:05:22.939ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_91a012db-ba8e-458f-bad0-85c50bdcfbd2/crypt/zone file = sled-storage/src/dataset.rs:395
2642024-06-25T07:05:23.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 128.217399ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2652024-06-25T07:05:23.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 128.863205ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2662024-06-25T07:05:23.812ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2672024-06-25T07:05:24.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 256.110843ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2682024-06-25T07:05:24.462ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2692024-06-25T07:05:25.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 935.935542ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2702024-06-25T07:05:25.264ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.547056949s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2712024-06-25T07:05:25.264ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2722024-06-25T07:05:25.705ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_91a012db-ba8e-458f-bad0-85c50bdcfbd2 file = sled-storage/src/dataset.rs:480
2732024-06-25T07:05:25.901ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:477
2742024-06-25T07:05:25.901ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:394
2752024-06-25T07:05:25.901ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:379
2762024-06-25T07:05:25.901ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2772024-06-25T07:05:25.901ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2782024-06-25T07:05:26.097ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:304
2792024-06-25T07:05:26.097ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool)
2802024-06-25T07:05:27.187ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }
2812024-06-25T07:05:27.407ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:332
2822024-06-25T07:05:27.407ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:334
2832024-06-25T07:05:27.407ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:338
2842024-06-25T07:05:27.407ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:340
2852024-06-25T07:05:27.407ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-06-25T07:05:27.407ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2872024-06-25T07:05:27.407ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2882024-06-25T07:05:28.079ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2892024-06-25T07:05:28.079ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2902024-06-25T07:05:28.744ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-06-25T07:05:29.199ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bd1f77a7-498c-47a0-8675-d771ae1ccef9/crypt/zone file = sled-storage/src/dataset.rs:395
2922024-06-25T07:05:29.199ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2932024-06-25T07:05:29.646ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2942024-06-25T07:05:30.082ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2952024-06-25T07:05:30.196ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bd1f77a7-498c-47a0-8675-d771ae1ccef9 file = sled-storage/src/dataset.rs:480
2962024-06-25T07:05:30.200ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
2972024-06-25T07:05:30.205ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:477
2982024-06-25T07:05:30.205ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:394
2992024-06-25T07:05:30.205ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:379
3002024-06-25T07:05:30.205ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3012024-06-25T07:05:30.205ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022024-06-25T07:05:30.214ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:304
3032024-06-25T07:05:30.214ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool)
3042024-06-25T07:05:30.306ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }
3052024-06-25T07:05:30.314ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:332
3062024-06-25T07:05:30.314ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3072024-06-25T07:05:30.315ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3082024-06-25T07:05:30.315ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3092024-06-25T07:05:30.315ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-06-25T07:05:30.315ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-06-25T07:05:30.315ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3122024-06-25T07:05:30.351ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132024-06-25T07:05:30.358ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9d857f30-656d-45b2-a37a-c31b060c8fae/crypt/zone file = sled-storage/src/dataset.rs:395
3142024-06-25T07:05:30.486ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9d857f30-656d-45b2-a37a-c31b060c8fae file = sled-storage/src/dataset.rs:480
3152024-06-25T07:05:30.493ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:477
3162024-06-25T07:05:30.493ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:394
3172024-06-25T07:05:30.493ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:379
3182024-06-25T07:05:30.494ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3192024-06-25T07:05:30.494ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202024-06-25T07:05:30.504ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:304
3212024-06-25T07:05:30.504ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool)
3222024-06-25T07:05:30.600ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External }
3232024-06-25T07:05:30.608ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:332
3242024-06-25T07:05:30.608ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:334
3252024-06-25T07:05:30.608ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:338
3262024-06-25T07:05:30.608ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:340
3272024-06-25T07:05:30.608ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282024-06-25T07:05:30.609ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-06-25T07:05:30.609ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3302024-06-25T07:05:30.643ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312024-06-25T07:05:30.651ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_73cdba2f-4771-4438-b5c3-84e7216dff0f/crypt/zone file = sled-storage/src/dataset.rs:395
3322024-06-25T07:05:30.774ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_73cdba2f-4771-4438-b5c3-84e7216dff0f file = sled-storage/src/dataset.rs:480
3332024-06-25T07:05:30.781ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:477
3342024-06-25T07:05:30.782ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:394
3352024-06-25T07:05:30.782ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:379
3362024-06-25T07:05:30.782ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3372024-06-25T07:05:30.782ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382024-06-25T07:05:30.791ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:304
3392024-06-25T07:05:30.791ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool)
3402024-06-25T07:05:30.884ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External }
3412024-06-25T07:05:30.892ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:332
3422024-06-25T07:05:30.892ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:334
3432024-06-25T07:05:30.892ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:338
3442024-06-25T07:05:30.892ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:340
3452024-06-25T07:05:30.892ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462024-06-25T07:05:30.892ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-06-25T07:05:30.892ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3482024-06-25T07:05:30.896ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.976271177s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
3492024-06-25T07:05:30.927ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-06-25T07:05:30.935ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_48b3c1a3-2c17-4973-8e17-8af9bebce768/crypt/zone file = sled-storage/src/dataset.rs:395
3512024-06-25T07:05:31.058ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_48b3c1a3-2c17-4973-8e17-8af9bebce768 file = sled-storage/src/dataset.rs:480
3522024-06-25T07:05:31.066ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:477
3532024-06-25T07:05:31.066ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:394
3542024-06-25T07:05:31.066ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:379
3552024-06-25T07:05:31.066ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3562024-06-25T07:05:31.066ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-06-25T07:05:31.076ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:304
3582024-06-25T07:05:31.076ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = eba9a72e-79ea-4722-8854-b5f41ec1c20b (zpool)
3592024-06-25T07:05:31.171ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: eba9a72e-79ea-4722-8854-b5f41ec1c20b (zpool), kind: External }
3602024-06-25T07:05:31.179ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:332
3612024-06-25T07:05:31.179ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:334
3622024-06-25T07:05:31.179ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:338
3632024-06-25T07:05:31.179ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:340
3642024-06-25T07:05:31.179ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-06-25T07:05:31.179ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-06-25T07:05:31.179ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3672024-06-25T07:05:31.203ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
3682024-06-25T07:05:31.214ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-06-25T07:05:31.222ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crypt/zone file = sled-storage/src/dataset.rs:395
3702024-06-25T07:05:31.344ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b file = sled-storage/src/dataset.rs:480
3712024-06-25T07:05:31.352ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:477
3722024-06-25T07:05:31.352ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:394
3732024-06-25T07:05:31.352ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:379
3742024-06-25T07:05:31.352ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3752024-06-25T07:05:31.352ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762024-06-25T07:05:31.361ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:304
3772024-06-25T07:05:31.361ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf (zpool)
3782024-06-25T07:05:31.451ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf (zpool), kind: External }
3792024-06-25T07:05:31.459ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:332
3802024-06-25T07:05:31.459ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:334
3812024-06-25T07:05:31.459ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:338
3822024-06-25T07:05:31.459ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:340
3832024-06-25T07:05:31.459ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-06-25T07:05:31.459ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-06-25T07:05:31.459ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3862024-06-25T07:05:31.494ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3872024-06-25T07:05:31.502ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf/crypt/zone file = sled-storage/src/dataset.rs:395
3882024-06-25T07:05:31.582ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2233
3892024-06-25T07:05:31.627ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf file = sled-storage/src/dataset.rs:480
3902024-06-25T07:05:31.635ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:477
3912024-06-25T07:05:31.635ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:394
3922024-06-25T07:05:31.635ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:379
3932024-06-25T07:05:31.635ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3942024-06-25T07:05:31.635ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3952024-06-25T07:05:31.644ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:304
3962024-06-25T07:05:31.644ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 6c00033c-63f1-47a0-8b42-6f61b082d646 (zpool)
3972024-06-25T07:05:31.738ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 6c00033c-63f1-47a0-8b42-6f61b082d646 (zpool), kind: External }
3982024-06-25T07:05:31.745ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:332
3992024-06-25T07:05:31.745ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:334
4002024-06-25T07:05:31.745ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:338
4012024-06-25T07:05:31.745ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:340
4022024-06-25T07:05:31.745ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-06-25T07:05:31.745ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-06-25T07:05:31.745ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4052024-06-25T07:05:31.748ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
4062024-06-25T07:05:31.779ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072024-06-25T07:05:31.786ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6c00033c-63f1-47a0-8b42-6f61b082d646/crypt/zone file = sled-storage/src/dataset.rs:395
4082024-06-25T07:05:31.902ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6c00033c-63f1-47a0-8b42-6f61b082d646 file = sled-storage/src/dataset.rs:480
4092024-06-25T07:05:31.910ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:477
4102024-06-25T07:05:31.910ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:394
4112024-06-25T07:05:31.910ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:379
4122024-06-25T07:05:31.910ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
4132024-06-25T07:05:31.910ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142024-06-25T07:05:31.920ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:304
4152024-06-25T07:05:31.920ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 6897e83c-187d-4573-a81f-bb7d6f202eb3 (zpool)
4162024-06-25T07:05:32.016ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 6897e83c-187d-4573-a81f-bb7d6f202eb3 (zpool), kind: External }
4172024-06-25T07:05:32.024ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:332
4182024-06-25T07:05:32.024ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:334
4192024-06-25T07:05:32.024ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:338
4202024-06-25T07:05:32.024ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:340
4212024-06-25T07:05:32.024ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-06-25T07:05:32.024ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232024-06-25T07:05:32.024ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4242024-06-25T07:05:32.058ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252024-06-25T07:05:32.066ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6897e83c-187d-4573-a81f-bb7d6f202eb3/crypt/zone file = sled-storage/src/dataset.rs:395
4262024-06-25T07:05:32.185ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6897e83c-187d-4573-a81f-bb7d6f202eb3 file = sled-storage/src/dataset.rs:480
4272024-06-25T07:05:32.192ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:477
4282024-06-25T07:05:32.192ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:394
4292024-06-25T07:05:32.192ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4302024-06-25T07:05:32.193ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 97ed7846-dc54-4083-af8f-8638d77ed528 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e538e077-d59a-4cd5-a9f6-4ddd0689c38f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: eba9a72e-79ea-4722-8854-b5f41ec1c20b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: 44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: 6c00033c-63f1-47a0-8b42-6f61b082d646 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: 6897e83c-187d-4573-a81f-bb7d6f202eb3 (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4312024-06-25T07:05:32.193ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
4322024-06-25T07:05:32.193ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
4332024-06-25T07:05:32.193ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4342024-06-25T07:05:32.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 12099337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36278 req_id = 31b757b4-dcc0-4f3a-aef5-78632318ffb5 response_code = 200 uri = /omicron-physical-disks
4352024-06-25T07:05:32.205ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
4362024-06-25T07:05:32.223ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 5db22e43-6365-46c5-b748-3751364244db, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3391e049-0617-4e88-8951-ec5bf4a53548, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
4372024-06-25T07:05:32.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63476
4382024-06-25T07:05:32.224ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5db22e43-6365-46c5-b748-3751364244db, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4392024-06-25T07:05:32.224ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5db22e43-6365-46c5-b748-3751364244db, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4402024-06-25T07:05:32.275ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4412024-06-25T07:05:32.275ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4422024-06-25T07:05:32.324ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3391e049-0617-4e88-8951-ec5bf4a53548, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4432024-06-25T07:05:32.324ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3391e049-0617-4e88-8951-ec5bf4a53548, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: InternalDns }, responder: ... }
4442024-06-25T07:05:32.372ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4452024-06-25T07:05:32.372ZINFOSledAgent (ServiceManager): No ledger in /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/omicron-zones.json file = common/src/ledger.rs:188
4462024-06-25T07:05:32.372ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/omicron-zones.json file = common/src/ledger.rs:188
4472024-06-25T07:05:32.372ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4482024-06-25T07:05:32.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4492024-06-25T07:05:32.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4502024-06-25T07:05:32.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4512024-06-25T07:05:32.465ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548 file = illumos-utils/src/zone.rs:315
4522024-06-25T07:05:32.469ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db file = illumos-utils/src/zone.rs:315
4532024-06-25T07:05:32.472ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21 file = illumos-utils/src/zone.rs:315
4542024-06-25T07:05:32.484ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548 file = illumos-utils/src/zone.rs:354
4552024-06-25T07:05:32.488ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db file = illumos-utils/src/zone.rs:354
4562024-06-25T07:05:32.492ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21 file = illumos-utils/src/zone.rs:354
4572024-06-25T07:05:33.208ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/6ec53d70-2eff-4360-abaf-e88d5a5744b1): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
4582024-06-25T07:05:34.015ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4592024-06-25T07:05:34.015ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4602024-06-25T07:05:34.015ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4612024-06-25T07:05:34.500ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4622024-06-25T07:05:34.981ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4632024-06-25T07:05:34.981ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4642024-06-25T07:05:34.981ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4652024-06-25T07:05:34.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 48.385264ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4662024-06-25T07:05:34.988ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
4672024-06-25T07:05:34.991ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
4682024-06-25T07:05:35.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 129.57882ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4692024-06-25T07:05:35.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 43.29016ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
4702024-06-25T07:05:35.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 47.059451ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
4712024-06-25T07:05:35.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 55.743315ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
4722024-06-25T07:05:35.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 130.876843ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
4732024-06-25T07:05:35.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 141.780753ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4742024-06-25T07:05:35.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 213.461832ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
4752024-06-25T07:05:35.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 293.710733ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
4762024-06-25T07:05:35.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 328.855928ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4772024-06-25T07:05:35.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 385.143377ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
4782024-06-25T07:05:35.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 416.642689ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
4792024-06-25T07:05:35.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 406.00459ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4802024-06-25T07:05:36.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 527.300339ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
4812024-06-25T07:05:36.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 793.718225ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
4822024-06-25T07:05:36.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 882.629455ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4832024-06-25T07:05:36.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 1.461234348s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
4842024-06-25T07:05:36.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 741.525502ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
4852024-06-25T07:05:37.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 712.774762ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4862024-06-25T07:05:37.633ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:9fb2::2 exists in switch zone file = sled-agent/src/services.rs:2250
4872024-06-25T07:05:37.633ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4882024-06-25T07:05:37.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 759.010671ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
4892024-06-25T07:05:37.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 511.678265ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4902024-06-25T07:05:38.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 709.023127ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
4912024-06-25T07:05:38.182ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fe7f:8dc7 file = sled-agent/src/services.rs:2257
4922024-06-25T07:05:38.188ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2318
4932024-06-25T07:05:38.314ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2503
4942024-06-25T07:05:38.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 796.454311ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
4952024-06-25T07:05:38.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 1.398757913s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
4962024-06-25T07:05:38.569ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2667
4972024-06-25T07:05:38.759ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2382
4982024-06-25T07:05:38.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 648.490484ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
4992024-06-25T07:05:39.054ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2417
5002024-06-25T07:05:39.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 1.001960367s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
5012024-06-25T07:05:39.248ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2717
5022024-06-25T07:05:39.420ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2744
5032024-06-25T07:05:39.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 718.530978ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
5042024-06-25T07:05:39.625ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2611
5052024-06-25T07:05:39.794ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2411
5062024-06-25T07:05:39.804ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3803 new = [fd00:1122:3344:101::2, ::1] old = [::1]
5072024-06-25T07:05:39.804ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3819
5082024-06-25T07:05:39.804ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
5092024-06-25T07:05:39.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 741.275491ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
5102024-06-25T07:05:40.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 1.330280743s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
5112024-06-25T07:05:40.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548") failed: Property not found. retry in 862.384544ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
5122024-06-25T07:05:40.354ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3827
5132024-06-25T07:05:40.360ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3883
5142024-06-25T07:05:40.496ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:3945
5152024-06-25T07:05:40.593ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3926 rack_subnet = fd00:1122:3344::
5162024-06-25T07:05:40.615ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:3973
5172024-06-25T07:05:40.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21") failed: Property not found. retry in 1.137431632s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
5182024-06-25T07:05:40.712ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4000
5192024-06-25T07:05:40.827ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:369
5202024-06-25T07:05:40.860ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:417
5212024-06-25T07:05:40.890ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:656
5222024-06-25T07:05:40.890ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:694
5232024-06-25T07:05:40.891ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:697 uptime = 2
5242024-06-25T07:05:40.891ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:439
5252024-06-25T07:05:40.964ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5262024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5272024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5282024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5292024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5302024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5312024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5322024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5332024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5342024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5352024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5362024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5372024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5382024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5392024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5402024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5412024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5422024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5432024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5442024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5452024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5462024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5472024-06-25T07:05:40.964ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5482024-06-25T07:05:41.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db") failed: Property not found. retry in 784.724306ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
5492024-06-25T07:05:42.295ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_internal_dns_3391e049-0617-4e88-8951-ec5bf4a53548
5502024-06-25T07:05:42.295ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_internal_dns_5db22e43-6365-46c5-b748-3751364244db
5512024-06-25T07:05:42.295ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_internal_dns_7eb07c85-ea8e-4595-8c41-c08f68268a21
5522024-06-25T07:05:42.295ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5532024-06-25T07:05:42.295ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5542024-06-25T07:05:42.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 10072310 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:63476 req_id = f09d993d-c365-4771-841c-671bb3eaac07 response_code = 204 uri = /omicron-zones
5552024-06-25T07:05:42.297ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5562024-06-25T07:05:43.833ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 135.820258ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5572024-06-25T07:05:44.037ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5582024-06-25T07:05:44.209ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 134.647607ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5592024-06-25T07:05:44.309ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57354
5602024-06-25T07:05:44.309ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 54 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57354 req_id = d7608df0-57a2-4b59-86a2-eef08ff344f7 response_code = 200 uri = /baseboard
5612024-06-25T07:05:44.428ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5622024-06-25T07:05:44.493ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:585
5632024-06-25T07:05:44.493ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
5642024-06-25T07:05:44.524ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
5652024-06-25T07:05:44.524ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
5662024-06-25T07:05:44.524ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
5672024-06-25T07:05:44.553ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 5db22e43-6365-46c5-b748-3751364244db, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3391e049-0617-4e88-8951-ec5bf4a53548, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: cd502136-0626-42c7-9766-0fc0993a655a, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 5894e109-b295-437e-8d83-5e590a8dbbe1, kind: Service { id: cd502136-0626-42c7-9766-0fc0993a655a }, name: Name("ntp-cd502136-0626-42c7-9766-0fc0993a655a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 46])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
5682024-06-25T07:05:44.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43755
5692024-06-25T07:05:44.553ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5db22e43-6365-46c5-b748-3751364244db, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5702024-06-25T07:05:44.553ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5db22e43-6365-46c5-b748-3751364244db, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5712024-06-25T07:05:44.575ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5722024-06-25T07:05:44.575ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5732024-06-25T07:05:44.594ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3391e049-0617-4e88-8951-ec5bf4a53548, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5742024-06-25T07:05:44.594ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3391e049-0617-4e88-8951-ec5bf4a53548, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: InternalDns }, responder: ... }
5752024-06-25T07:05:44.613ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5762024-06-25T07:05:44.613ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/omicron-zones.json file = common/src/ledger.rs:177
5772024-06-25T07:05:44.613ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/omicron-zones.json file = common/src/ledger.rs:177
5782024-06-25T07:05:44.613ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5792024-06-25T07:05:44.624ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
5802024-06-25T07:05:44.656ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
5812024-06-25T07:05:44.657ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
5822024-06-25T07:05:44.657ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
5832024-06-25T07:05:44.700ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 195, 46]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5842024-06-25T07:05:44.700ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = ntp
5852024-06-25T07:05:44.700ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
5862024-06-25T07:05:44.700ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
5872024-06-25T07:05:44.700ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
5882024-06-25T07:05:44.702ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5892024-06-25T07:05:44.724ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a file = illumos-utils/src/zone.rs:315
5902024-06-25T07:05:44.742ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a file = illumos-utils/src/zone.rs:354
5912024-06-25T07:05:45.421ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5922024-06-25T07:05:45.421ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
5932024-06-25T07:05:45.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 38.967788ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
5942024-06-25T07:05:45.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 132.010049ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
5952024-06-25T07:05:45.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 207.549548ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
5962024-06-25T07:05:45.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 308.156694ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
5972024-06-25T07:05:46.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 1.137996142s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
5982024-06-25T07:05:47.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 873.600702ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
5992024-06-25T07:05:48.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 1.211969334s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
6002024-06-25T07:05:49.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 738.461806ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
6012024-06-25T07:05:50.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 573.000822ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
6022024-06-25T07:05:50.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a") failed: Property not found. retry in 1.094372113s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
6032024-06-25T07:05:52.007ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a
6042024-06-25T07:05:52.007ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6052024-06-25T07:05:52.008ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6062024-06-25T07:05:52.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7454997 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43755 req_id = f453e626-9786-4069-8bbe-e09e3f346e1c response_code = 204 uri = /omicron-zones
6072024-06-25T07:05:52.011ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:626
6082024-06-25T07:05:52.039ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6092024-06-25T07:05:52.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44110
6102024-06-25T07:05:52.048ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6112024-06-25T07:05:52.048ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 9282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44110 req_id = 10baadff-3ef5-4d99-9edf-9f3d6b7d8b2c response_code = 500 uri = /timesync
6122024-06-25T07:05:52.050ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6132024-06-25T07:05:52.226ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6142024-06-25T07:05:52.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43367
6152024-06-25T07:05:56.235ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6162024-06-25T07:05:56.235ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4008293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43367 req_id = 009730b5-10b8-4e52-97be-3b70f50eecde response_code = 500 uri = /timesync
6172024-06-25T07:05:56.239ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6182024-06-25T07:05:56.344ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6192024-06-25T07:05:56.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42324
6202024-06-25T07:05:56.353ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6212024-06-25T07:05:56.353ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 8643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42324 req_id = 80446b24-4a0d-4bd9-b984-a94050478eee response_code = 500 uri = /timesync
6222024-06-25T07:05:56.354ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6232024-06-25T07:05:56.530ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6242024-06-25T07:05:56.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35667
6252024-06-25T07:06:00.539ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_cd502136-0626-42c7-9766-0fc0993a655a': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3533
6262024-06-25T07:06:00.539ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4009095 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35667 req_id = 8b5202c6-1294-49f7-9472-770da880aaae response_code = 500 uri = /timesync
6272024-06-25T07:06:00.542ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6282024-06-25T07:06:00.828ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6292024-06-25T07:06:00.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63586
6302024-06-25T07:06:00.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63586 req_id = d4c7b176-e2b1-420e-9ec7-b869997d1fc4 response_code = 200 uri = /timesync
6312024-06-25T07:06:00.841ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6322024-06-25T07:06:00.841ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6332024-06-25T07:06:01.057ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6342024-06-25T07:06:01.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35407
6352024-06-25T07:06:01.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35407 req_id = 13a00029-f989-4435-824e-a80ad3e0353f response_code = 200 uri = /timesync
6362024-06-25T07:06:01.069ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6372024-06-25T07:06:01.069ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6382024-06-25T07:06:01.456ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6392024-06-25T07:06:01.456ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58074
6402024-06-25T07:06:01.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58074 req_id = 505eddee-2d41-423f-8a27-d198fb25f087 response_code = 200 uri = /timesync
6412024-06-25T07:06:01.465ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6422024-06-25T07:06:01.465ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6432024-06-25T07:06:01.784ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6442024-06-25T07:06:01.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56368
6452024-06-25T07:06:01.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56368 req_id = c3cd4741-40a5-4583-bef4-e039882b63da response_code = 200 uri = /timesync
6462024-06-25T07:06:01.795ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6472024-06-25T07:06:01.795ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6482024-06-25T07:06:01.913ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 296.603732ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
6492024-06-25T07:06:02.069ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6502024-06-25T07:06:02.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55732
6512024-06-25T07:06:02.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8893 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55732 req_id = 9c785479-a31d-4162-99a2-5c88eb45b6f4 response_code = 200 uri = /timesync
6522024-06-25T07:06:02.081ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6532024-06-25T07:06:02.081ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6542024-06-25T07:06:03.467ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6552024-06-25T07:06:03.467ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41762
6562024-06-25T07:06:03.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41762 req_id = df056987-3495-439f-b5ca-c0c77c7468ee response_code = 200 uri = /timesync
6572024-06-25T07:06:03.478ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6582024-06-25T07:06:03.478ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6592024-06-25T07:06:04.232ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6602024-06-25T07:06:04.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52888
6612024-06-25T07:06:04.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7626 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52888 req_id = 2f295924-4df0-4798-900f-e03d6e9a34bc response_code = 200 uri = /timesync
6622024-06-25T07:06:04.242ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6632024-06-25T07:06:04.242ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6642024-06-25T07:06:04.587ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6652024-06-25T07:06:04.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49890
6662024-06-25T07:06:04.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9535 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49890 req_id = 245c9718-8e01-4192-9f3c-2a7bccc8d86d response_code = 200 uri = /timesync
6672024-06-25T07:06:04.601ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.043314885 } file = sled-agent/src/rack_setup/service.rs:634
6682024-06-25T07:06:04.601ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6692024-06-25T07:06:05.160ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6702024-06-25T07:06:05.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61086
6712024-06-25T07:06:05.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61086 req_id = c97fd288-f176-4a83-8116-accb2d9132d8 response_code = 200 uri = /timesync
6722024-06-25T07:06:05.172ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.041762549 } file = sled-agent/src/rack_setup/service.rs:634
6732024-06-25T07:06:05.172ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6742024-06-25T07:06:05.848ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6752024-06-25T07:06:05.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51232
6762024-06-25T07:06:05.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51232 req_id = f4d49f85-7d0f-4ea3-bafe-bb7135596d7f response_code = 200 uri = /timesync
6772024-06-25T07:06:05.859ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.039895345 } file = sled-agent/src/rack_setup/service.rs:634
6782024-06-25T07:06:05.859ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6792024-06-25T07:06:06.860ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6802024-06-25T07:06:06.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35107
6812024-06-25T07:06:06.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8546 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35107 req_id = 6d0eb80d-a21d-4e7a-9dce-f522eac1c6c4 response_code = 200 uri = /timesync
6822024-06-25T07:06:06.873ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.037147284 } file = sled-agent/src/rack_setup/service.rs:634
6832024-06-25T07:06:06.873ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6842024-06-25T07:06:08.605ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6852024-06-25T07:06:08.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60565
6862024-06-25T07:06:08.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8910 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60565 req_id = dc772715-55db-4f13-92e5-2ba0f7bfcb4d response_code = 200 uri = /timesync
6872024-06-25T07:06:08.618ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.032405443 } file = sled-agent/src/rack_setup/service.rs:634
6882024-06-25T07:06:08.618ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6892024-06-25T07:06:10.924ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6902024-06-25T07:06:10.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38467
6912024-06-25T07:06:10.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38467 req_id = 37980388-38a3-475a-85c5-571bd418ef84 response_code = 200 uri = /timesync
6922024-06-25T07:06:10.936ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.026108313 } file = sled-agent/src/rack_setup/service.rs:634
6932024-06-25T07:06:10.936ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6942024-06-25T07:06:12.566ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6952024-06-25T07:06:12.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65463
6962024-06-25T07:06:12.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8777 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65463 req_id = 4ce21819-26bf-450f-9071-4e06661f2699 response_code = 200 uri = /timesync
6972024-06-25T07:06:12.578ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.021649629 } file = sled-agent/src/rack_setup/service.rs:634
6982024-06-25T07:06:12.578ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6992024-06-25T07:06:15.076ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39594
7002024-06-25T07:06:15.076ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 64 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39594 req_id = 00d42006-68bb-4c53-b94f-133608fee14f response_code = 200 uri = /baseboard
7012024-06-25T07:06:15.252ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7022024-06-25T07:06:15.252ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51633
7032024-06-25T07:06:15.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51633 req_id = 037ffb6e-6d78-4904-b1da-75ed9e8ef1ff response_code = 200 uri = /timesync
7042024-06-25T07:06:15.263ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.014356622 } file = sled-agent/src/rack_setup/service.rs:634
7052024-06-25T07:06:15.263ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7062024-06-25T07:06:17.972ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 366.000214ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
7072024-06-25T07:06:18.740ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7082024-06-25T07:06:18.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42788
7092024-06-25T07:06:18.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8893 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42788 req_id = 03206d1c-9c04-4408-8d35-3717bd046d88 response_code = 200 uri = /timesync
7102024-06-25T07:06:18.752ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.004881941 } file = sled-agent/src/rack_setup/service.rs:634
7112024-06-25T07:06:18.752ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7122024-06-25T07:06:21.130ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7132024-06-25T07:06:21.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55081
7142024-06-25T07:06:21.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55081 req_id = 703b26ad-24fa-4184-9a37-d07740658f19 response_code = 200 uri = /timesync
7152024-06-25T07:06:21.142ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 2.712e-6 } file = sled-agent/src/rack_setup/service.rs:634
7162024-06-25T07:06:21.142ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7172024-06-25T07:06:26.178ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7182024-06-25T07:06:26.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58652
7192024-06-25T07:06:26.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8508 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58652 req_id = 514a67fe-c5b4-44aa-924e-7a3684e4520a response_code = 200 uri = /timesync
7202024-06-25T07:06:26.189ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 2.684e-6 } file = sled-agent/src/rack_setup/service.rs:634
7212024-06-25T07:06:26.189ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7222024-06-25T07:06:29.310ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7232024-06-25T07:06:29.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54208
7242024-06-25T07:06:29.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8860 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54208 req_id = 677850b1-f40a-44e0-8e92-96588336c3ea response_code = 200 uri = /timesync
7252024-06-25T07:06:29.322ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 2.668e-6 } file = sled-agent/src/rack_setup/service.rs:634
7262024-06-25T07:06:29.322ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7272024-06-25T07:06:32.392ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7282024-06-25T07:06:32.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49108
7292024-06-25T07:06:32.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8882 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49108 req_id = 7e0652c1-6eee-44fc-9078-1b2effec7427 response_code = 200 uri = /timesync
7302024-06-25T07:06:32.404ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 2.651e-6 } file = sled-agent/src/rack_setup/service.rs:634
7312024-06-25T07:06:32.404ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7322024-06-25T07:06:33.365ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 769.932398ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
7332024-06-25T07:06:41.070ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7342024-06-25T07:06:41.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57468
7352024-06-25T07:06:41.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57468 req_id = 3074660a-bef7-486d-b6e5-39d362f7c2dd response_code = 200 uri = /timesync
7362024-06-25T07:06:41.083ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 2.604e-6 } file = sled-agent/src/rack_setup/service.rs:634
7372024-06-25T07:06:41.083ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7382024-06-25T07:06:45.092ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44315
7392024-06-25T07:06:45.092ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44315 req_id = e5b6ea63-9500-40ea-8bde-2026e1e861d3 response_code = 200 uri = /baseboard
7402024-06-25T07:06:49.168ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.621263458s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
7412024-06-25T07:06:52.613ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7422024-06-25T07:06:52.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38830
7432024-06-25T07:06:52.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8814 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38830 req_id = 918afa0d-05b8-48a5-9e5f-382af868b4e7 response_code = 200 uri = /timesync
7442024-06-25T07:06:52.625ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 2.542e-6 } file = sled-agent/src/rack_setup/service.rs:634
7452024-06-25T07:06:52.625ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7462024-06-25T07:07:00.064ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7472024-06-25T07:07:00.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47544
7482024-06-25T07:07:00.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47544 req_id = e7c3bef3-8b17-493c-b6b0-65392dbf3bc7 response_code = 200 uri = /timesync
7492024-06-25T07:07:00.075ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 2.501e-6 } file = sled-agent/src/rack_setup/service.rs:634
7502024-06-25T07:07:00.075ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7512024-06-25T07:07:06.824ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.491853628s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
7522024-06-25T07:07:12.103ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7532024-06-25T07:07:12.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61877
7542024-06-25T07:07:12.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9629 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61877 req_id = a9f799da-7961-488e-a2f3-dfd9d0c60375 response_code = 200 uri = /timesync
7552024-06-25T07:07:12.118ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.005907925 } file = sled-agent/src/rack_setup/service.rs:634
7562024-06-25T07:07:12.118ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7572024-06-25T07:07:15.125ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47471
7582024-06-25T07:07:15.125ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47471 req_id = a9a519b1-bc44-4711-ab79-544db84b64b0 response_code = 200 uri = /baseboard
7592024-06-25T07:07:24.350ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.086045278s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
7602024-06-25T07:07:28.640ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7612024-06-25T07:07:28.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44014
7622024-06-25T07:07:28.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8754 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44014 req_id = 1bb8223f-2268-4f70-a2c8-7c8a634f3f64 response_code = 200 uri = /timesync
7632024-06-25T07:07:28.652ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.005475803 } file = sled-agent/src/rack_setup/service.rs:634
7642024-06-25T07:07:28.652ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7652024-06-25T07:07:45.158ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47648
7662024-06-25T07:07:45.158ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47648 req_id = af45ba19-c706-40b7-b110-befd48b6f4c3 response_code = 200 uri = /baseboard
7672024-06-25T07:07:49.469ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 20.458215344s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
7682024-06-25T07:07:50.052ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7692024-06-25T07:07:50.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51430
7702024-06-25T07:07:50.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51430 req_id = 7b1e5658-1406-4c46-a8b0-9b8a85eb1a2b response_code = 200 uri = /timesync
7712024-06-25T07:07:50.064ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.004916239 } file = sled-agent/src/rack_setup/service.rs:634
7722024-06-25T07:07:50.064ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7732024-06-25T07:08:12.159ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7742024-06-25T07:08:12.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52930
7752024-06-25T07:08:12.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52930 req_id = bf6656bf-cf87-4c66-bffd-99bd19dff8b4 response_code = 200 uri = /timesync
7762024-06-25T07:08:12.170ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.004338551 } file = sled-agent/src/rack_setup/service.rs:634
7772024-06-25T07:08:12.170ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7782024-06-25T07:08:15.194ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63877
7792024-06-25T07:08:15.194ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63877 req_id = a2272470-50fa-4be8-97ed-5bac7e82409d response_code = 200 uri = /baseboard
7802024-06-25T07:08:24.963ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 32.234701334s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
7812024-06-25T07:08:27.953ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7822024-06-25T07:08:27.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34534
7832024-06-25T07:08:27.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 20842 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34534 req_id = fb4db3e7-0f39-4918-aaab-74f3be01d9aa response_code = 200 uri = /timesync
7842024-06-25T07:08:27.977ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 394502151, ip_addr: 23.131.160.7, stratum: 3, ref_time: 1719299293.2353785, correction: -4.923e-6 } file = sled-agent/src/rack_setup/service.rs:634
7852024-06-25T07:08:27.977ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1224
7862024-06-25T07:08:28.005ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 5db22e43-6365-46c5-b748-3751364244db, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3391e049-0617-4e88-8951-ec5bf4a53548, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: cd502136-0626-42c7-9766-0fc0993a655a, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 5894e109-b295-437e-8d83-5e590a8dbbe1, kind: Service { id: cd502136-0626-42c7-9766-0fc0993a655a }, name: Name("ntp-cd502136-0626-42c7-9766-0fc0993a655a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 46])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 908ccae6-e2ae-437f-97b1-6e34b094859a, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9b0df50c-c445-439e-90f5-eb10853e39c3, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 465eb41f-4880-4a29-95e7-b0fca4e4cb63, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External } } } }, OmicronZoneConfig { id: 6ce8da26-8d27-40ea-a3a2-49002174d50f, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External } } } }, OmicronZoneConfig { id: 106fbba8-16ba-474f-bae5-20cf7d63514b, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
7872024-06-25T07:08:28.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61298
7882024-06-25T07:08:28.006ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5db22e43-6365-46c5-b748-3751364244db, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7892024-06-25T07:08:28.006ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5db22e43-6365-46c5-b748-3751364244db, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7902024-06-25T07:08:28.026ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7912024-06-25T07:08:28.026ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7922024-06-25T07:08:28.045ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3391e049-0617-4e88-8951-ec5bf4a53548, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7932024-06-25T07:08:28.045ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3391e049-0617-4e88-8951-ec5bf4a53548, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: InternalDns }, responder: ... }
7942024-06-25T07:08:28.063ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 908ccae6-e2ae-437f-97b1-6e34b094859a, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7952024-06-25T07:08:28.063ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 908ccae6-e2ae-437f-97b1-6e34b094859a, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7962024-06-25T07:08:28.129ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9b0df50c-c445-439e-90f5-eb10853e39c3, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7972024-06-25T07:08:28.129ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9b0df50c-c445-439e-90f5-eb10853e39c3, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7982024-06-25T07:08:28.193ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 465eb41f-4880-4a29-95e7-b0fca4e4cb63, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7992024-06-25T07:08:28.193ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 465eb41f-4880-4a29-95e7-b0fca4e4cb63, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8002024-06-25T07:08:28.257ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6ce8da26-8d27-40ea-a3a2-49002174d50f, dataset_name: DatasetName { pool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8012024-06-25T07:08:28.257ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 6ce8da26-8d27-40ea-a3a2-49002174d50f, dataset_name: DatasetName { pool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8022024-06-25T07:08:28.323ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 106fbba8-16ba-474f-bae5-20cf7d63514b, dataset_name: DatasetName { pool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8032024-06-25T07:08:28.324ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 106fbba8-16ba-474f-bae5-20cf7d63514b, dataset_name: DatasetName { pool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8042024-06-25T07:08:28.385ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8052024-06-25T07:08:28.385ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/omicron-zones.json file = common/src/ledger.rs:177
8062024-06-25T07:08:28.385ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/omicron-zones.json file = common/src/ledger.rs:177
8072024-06-25T07:08:28.386ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8082024-06-25T07:08:28.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8092024-06-25T07:08:28.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8102024-06-25T07:08:28.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8112024-06-25T07:08:28.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8122024-06-25T07:08:28.468ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8132024-06-25T07:08:28.564ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3 file = illumos-utils/src/zone.rs:315
8142024-06-25T07:08:28.569ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63 file = illumos-utils/src/zone.rs:315
8152024-06-25T07:08:28.573ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b file = illumos-utils/src/zone.rs:315
8162024-06-25T07:08:28.578ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a file = illumos-utils/src/zone.rs:315
8172024-06-25T07:08:28.583ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f file = illumos-utils/src/zone.rs:315
8182024-06-25T07:08:28.588ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3 file = illumos-utils/src/zone.rs:354
8192024-06-25T07:08:28.593ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63 file = illumos-utils/src/zone.rs:354
8202024-06-25T07:08:28.598ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b file = illumos-utils/src/zone.rs:354
8212024-06-25T07:08:28.602ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a file = illumos-utils/src/zone.rs:354
8222024-06-25T07:08:28.607ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f file = illumos-utils/src/zone.rs:354
8232024-06-25T07:08:31.619ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="6ce8da26-8d27-40ea-a3a2-49002174d50f"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::6]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8242024-06-25T07:08:31.619ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8252024-06-25T07:08:31.626ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="106fbba8-16ba-474f-bae5-20cf7d63514b"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::7]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8262024-06-25T07:08:31.627ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8272024-06-25T07:08:31.636ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="465eb41f-4880-4a29-95e7-b0fca4e4cb63"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::5]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8282024-06-25T07:08:31.637ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="9b0df50c-c445-439e-90f5-eb10853e39c3"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::4]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8292024-06-25T07:08:31.637ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8302024-06-25T07:08:31.642ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8312024-06-25T07:08:31.670ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="908ccae6-e2ae-437f-97b1-6e34b094859a"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::3]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8322024-06-25T07:08:31.670ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8332024-06-25T07:08:31.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 29.798024ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8342024-06-25T07:08:31.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 39.945685ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8352024-06-25T07:08:31.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 50.368572ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8362024-06-25T07:08:31.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 40.295338ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8372024-06-25T07:08:31.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 97.630941ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8382024-06-25T07:08:31.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 72.764638ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8392024-06-25T07:08:31.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 105.345855ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8402024-06-25T07:08:31.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 89.36172ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8412024-06-25T07:08:32.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 117.535645ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8422024-06-25T07:08:32.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 170.256227ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8432024-06-25T07:08:33.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 168.90303ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8442024-06-25T07:08:33.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 191.567109ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8452024-06-25T07:08:33.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 132.153326ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8462024-06-25T07:08:33.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 271.903505ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8472024-06-25T07:08:33.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 231.983122ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8482024-06-25T07:08:34.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 240.677459ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8492024-06-25T07:08:34.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 574.580283ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8502024-06-25T07:08:34.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 225.663204ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8512024-06-25T07:08:34.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 213.656246ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8522024-06-25T07:08:34.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 498.567547ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8532024-06-25T07:08:34.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 947.925216ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8542024-06-25T07:08:34.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 704.150578ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8552024-06-25T07:08:34.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 571.150704ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8562024-06-25T07:08:34.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 833.453858ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8572024-06-25T07:08:35.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 880.989123ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8582024-06-25T07:08:35.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 462.228962ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8592024-06-25T07:08:35.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 1.140521952s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8602024-06-25T07:08:35.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.232775844s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8612024-06-25T07:08:35.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 953.528455ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8622024-06-25T07:08:35.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 630.663466ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8632024-06-25T07:08:36.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 689.360515ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8642024-06-25T07:08:36.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 1.077270192s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8652024-06-25T07:08:36.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 1.087921718s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8662024-06-25T07:08:36.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 728.421599ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8672024-06-25T07:08:36.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 938.339558ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8682024-06-25T07:08:37.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 513.615346ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8692024-06-25T07:08:37.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 1.024462401s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8702024-06-25T07:08:37.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 702.978138ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8712024-06-25T07:08:37.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 1.187762609s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8722024-06-25T07:08:37.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 675.03995ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8732024-06-25T07:08:37.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 1.46088852s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8742024-06-25T07:08:38.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.333728144s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8752024-06-25T07:08:38.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 1.286164398s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8762024-06-25T07:08:38.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 611.139471ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8772024-06-25T07:08:38.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 1.21126305s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8782024-06-25T07:08:39.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 1.053706948s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8792024-06-25T07:08:39.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 1.257924724s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8802024-06-25T07:08:39.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.323532327s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8812024-06-25T07:08:39.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 701.34779ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8822024-06-25T07:08:40.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 1.486107109s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8832024-06-25T07:08:40.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 524.475687ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8842024-06-25T07:08:40.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 1.498693481s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8852024-06-25T07:08:40.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 1.31032729s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8862024-06-25T07:08:40.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 1.481441608s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8872024-06-25T07:08:40.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 532.653409ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8882024-06-25T07:08:41.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.355923656s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8892024-06-25T07:08:41.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a") failed: Property not found. retry in 874.67617ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
8902024-06-25T07:08:41.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3") failed: Property not found. retry in 517.740787ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
8912024-06-25T07:08:42.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 653.447438ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8922024-06-25T07:08:42.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 964.732222ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8932024-06-25T07:08:42.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 1.324982183s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8942024-06-25T07:08:42.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.191607646s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8952024-06-25T07:08:43.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 702.400705ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8962024-06-25T07:08:43.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 1.284813774s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
8972024-06-25T07:08:44.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 1.356506088s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
8982024-06-25T07:08:44.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 815.196224ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
8992024-06-25T07:08:44.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.26217411s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
9002024-06-25T07:08:45.233ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40914
9012024-06-25T07:08:45.233ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 115 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40914 req_id = 5e128d86-9ebb-4b84-bafe-4c59fc96a1d8 response_code = 200 uri = /baseboard
9022024-06-25T07:08:45.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 708.606746ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
9032024-06-25T07:08:45.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 1.269400295s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
9042024-06-25T07:08:45.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 987.046747ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
9052024-06-25T07:08:46.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.284302267s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
9062024-06-25T07:08:46.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 1.087265898s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
9072024-06-25T07:08:46.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 1.062717429s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
9082024-06-25T07:08:47.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.427000817s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
9092024-06-25T07:08:47.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 955.170176ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
9102024-06-25T07:08:48.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 1.34118012s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
9112024-06-25T07:08:48.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 591.28632ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
9122024-06-25T07:08:48.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.169222593s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
9132024-06-25T07:08:49.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 996.456765ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
9142024-06-25T07:08:49.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 996.428313ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
9152024-06-25T07:08:50.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.296370384s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
9162024-06-25T07:08:50.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 656.068307ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
9172024-06-25T07:08:50.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 654.352646ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
9182024-06-25T07:08:51.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 753.769537ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
9192024-06-25T07:08:51.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 576.879315ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
9202024-06-25T07:08:51.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63") failed: Property not found. retry in 1.429286924s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
9212024-06-25T07:08:51.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f") failed: Property not found. retry in 1.174926672s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
9222024-06-25T07:08:51.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b") failed: Property not found. retry in 924.209489ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
9232024-06-25T07:08:52.861ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_9b0df50c-c445-439e-90f5-eb10853e39c3
9242024-06-25T07:08:52.861ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_465eb41f-4880-4a29-95e7-b0fca4e4cb63
9252024-06-25T07:08:52.861ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b
9262024-06-25T07:08:52.861ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_908ccae6-e2ae-437f-97b1-6e34b094859a
9272024-06-25T07:08:52.861ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_cockroachdb_6ce8da26-8d27-40ea-a3a2-49002174d50f
9282024-06-25T07:08:52.861ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9292024-06-25T07:08:52.862ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9302024-06-25T07:08:52.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 24856217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61298 req_id = 75921fa0-f46e-4d01-8bf1-f69def3ff909 response_code = 204 uri = /omicron-zones
9312024-06-25T07:08:52.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51156
9322024-06-25T07:08:52.926ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 30062 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 93983241-9b9c-408d-9e83-39c1e5d64516 response_code = 500 uri = /cockroachdb
9332024-06-25T07:08:52.926ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "93983241-9b9c-408d-9e83-39c1e5d64516", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "93983241-9b9c-408d-9e83-39c1e5d64516" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 70.856427ms
9342024-06-25T07:08:53.027ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 28736 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 4361dacc-8c5a-4dea-9602-11b73f62b608 response_code = 500 uri = /cockroachdb
9352024-06-25T07:08:53.027ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4361dacc-8c5a-4dea-9602-11b73f62b608", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4361dacc-8c5a-4dea-9602-11b73f62b608" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 82.171972ms
9362024-06-25T07:08:53.141ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 30611 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = b8b36080-2cb6-4dfc-b837-94bfefa3dd26 response_code = 500 uri = /cockroachdb
9372024-06-25T07:08:53.141ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b8b36080-2cb6-4dfc-b837-94bfefa3dd26", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b8b36080-2cb6-4dfc-b837-94bfefa3dd26" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 94.809891ms
9382024-06-25T07:08:53.268ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 30043 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = ab696758-fad6-4a1e-9840-064f3e7199e7 response_code = 500 uri = /cockroachdb
9392024-06-25T07:08:53.268ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ab696758-fad6-4a1e-9840-064f3e7199e7", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ab696758-fad6-4a1e-9840-064f3e7199e7" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 134.288452ms
9402024-06-25T07:08:53.432ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 28176 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 6af48d1a-8911-4b93-b326-9306fa569bfc response_code = 500 uri = /cockroachdb
9412024-06-25T07:08:53.432ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6af48d1a-8911-4b93-b326-9306fa569bfc", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6af48d1a-8911-4b93-b326-9306fa569bfc" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 154.359234ms
9422024-06-25T07:08:53.615ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27955 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 4162d1bc-5f0a-4516-aade-a5931c606813 response_code = 500 uri = /cockroachdb
9432024-06-25T07:08:53.616ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4162d1bc-5f0a-4516-aade-a5931c606813", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:52 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4162d1bc-5f0a-4516-aade-a5931c606813" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 351.696279ms
9442024-06-25T07:08:53.999ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 30514 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 306672c2-37c3-47fb-946f-2700993aada3 response_code = 500 uri = /cockroachdb
9452024-06-25T07:08:53.999ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "306672c2-37c3-47fb-946f-2700993aada3", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "306672c2-37c3-47fb-946f-2700993aada3" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 414.917527ms
9462024-06-25T07:08:54.445ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 29680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 03928939-e2bc-490b-a5dd-16b4bc72dc82 response_code = 500 uri = /cockroachdb
9472024-06-25T07:08:54.446ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "03928939-e2bc-490b-a5dd-16b4bc72dc82", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:53 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "03928939-e2bc-490b-a5dd-16b4bc72dc82" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 412.386065ms
9482024-06-25T07:08:55.524ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 644401 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 772f0422-ddb6-4ad4-8adc-8d7b60f269cf response_code = 500 uri = /cockroachdb
9492024-06-25T07:08:55.524ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "772f0422-ddb6-4ad4-8adc-8d7b60f269cf", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "772f0422-ddb6-4ad4-8adc-8d7b60f269cf" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 442.746639ms
9502024-06-25T07:08:56.005ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 37849 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = a176eaa3-6f82-46dd-98bd-2bffb7de51f1 response_code = 500 uri = /cockroachdb
9512024-06-25T07:08:56.006ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a176eaa3-6f82-46dd-98bd-2bffb7de51f1", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a176eaa3-6f82-46dd-98bd-2bffb7de51f1" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 692.884961ms
9522024-06-25T07:08:56.747ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 46951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = e32ff22d-2dc8-46e5-93b9-e4778fdbdbfa response_code = 500 uri = /cockroachdb
9532024-06-25T07:08:56.747ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e32ff22d-2dc8-46e5-93b9-e4778fdbdbfa", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:55 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e32ff22d-2dc8-46e5-93b9-e4778fdbdbfa" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 674.478082ms
9542024-06-25T07:08:57.450ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27653 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 813e5600-b7f9-48b5-80c0-2a9a58e43ae9 response_code = 500 uri = /cockroachdb
9552024-06-25T07:08:57.450ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "813e5600-b7f9-48b5-80c0-2a9a58e43ae9", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:57 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "813e5600-b7f9-48b5-80c0-2a9a58e43ae9" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 831.196771ms
9562024-06-25T07:08:58.310ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = eb38fdff-478f-4aa8-ac1f-c0f56a13cbc9 response_code = 500 uri = /cockroachdb
9572024-06-25T07:08:58.311ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "eb38fdff-478f-4aa8-ac1f-c0f56a13cbc9", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:58 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "eb38fdff-478f-4aa8-ac1f-c0f56a13cbc9" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 992.708962ms
9582024-06-25T07:08:59.333ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27737 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 468c3c07-82c6-4837-8294-d5202398cd7d response_code = 500 uri = /cockroachdb
9592024-06-25T07:08:59.333ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "468c3c07-82c6-4837-8294-d5202398cd7d", "content-length": "124", "date": "Tue, 25 Jun 2024 07:08:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "468c3c07-82c6-4837-8294-d5202398cd7d" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 1.530825396s
9602024-06-25T07:09:00.893ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 28640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = ffb1400c-c429-4300-a715-932d73cfe06d response_code = 500 uri = /cockroachdb
9612024-06-25T07:09:00.893ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ffb1400c-c429-4300-a715-932d73cfe06d", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:00 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ffb1400c-c429-4300-a715-932d73cfe06d" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 1.389388343s
9622024-06-25T07:09:02.313ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 28822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = a9bb611f-edc2-4c97-b4ef-76c2df301951 response_code = 500 uri = /cockroachdb
9632024-06-25T07:09:02.313ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a9bb611f-edc2-4c97-b4ef-76c2df301951", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a9bb611f-edc2-4c97-b4ef-76c2df301951" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 1.33081929s
9642024-06-25T07:09:03.674ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 28372 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = c38da913-5c4f-4eea-b212-d7a8e96bfa7c response_code = 500 uri = /cockroachdb
9652024-06-25T07:09:03.674ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c38da913-5c4f-4eea-b212-d7a8e96bfa7c", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:03 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c38da913-5c4f-4eea-b212-d7a8e96bfa7c" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 1.825819879s
9662024-06-25T07:09:05.529ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27657 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 44212f12-64b3-47df-b802-50ec133f5063 response_code = 500 uri = /cockroachdb
9672024-06-25T07:09:05.529ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "44212f12-64b3-47df-b802-50ec133f5063", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:05 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "44212f12-64b3-47df-b802-50ec133f5063" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 2.79310588s
9682024-06-25T07:09:08.352ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27669 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 244ca6ef-9db6-4eee-8136-788124bbafe0 response_code = 500 uri = /cockroachdb
9692024-06-25T07:09:08.352ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "244ca6ef-9db6-4eee-8136-788124bbafe0", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:08 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "244ca6ef-9db6-4eee-8136-788124bbafe0" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 2.94439171s
9702024-06-25T07:09:11.326ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27598 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 1c47fb20-729f-48f1-a873-78b97f487a25 response_code = 500 uri = /cockroachdb
9712024-06-25T07:09:11.326ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1c47fb20-729f-48f1-a873-78b97f487a25", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1c47fb20-729f-48f1-a873-78b97f487a25" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 1.72650518s
9722024-06-25T07:09:12.243ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 83.36632807s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
9732024-06-25T07:09:13.082ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 28449 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 18ba8bb1-5a20-4c7e-a719-beecfeb62e66 response_code = 500 uri = /cockroachdb
9742024-06-25T07:09:13.082ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "18ba8bb1-5a20-4c7e-a719-beecfeb62e66", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "18ba8bb1-5a20-4c7e-a719-beecfeb62e66" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 2.639779916s
9752024-06-25T07:09:15.268ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57200
9762024-06-25T07:09:15.268ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57200 req_id = f4fe3978-96f6-416e-a00c-0908dc1ec35c response_code = 200 uri = /baseboard
9772024-06-25T07:09:15.750ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 26808 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 0c69443d-2fbb-474a-ad47-ec7d57340bea response_code = 500 uri = /cockroachdb
9782024-06-25T07:09:15.750ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0c69443d-2fbb-474a-ad47-ec7d57340bea", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0c69443d-2fbb-474a-ad47-ec7d57340bea" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 3.883980531s
9792024-06-25T07:09:19.663ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27770 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 66316175-3d9c-4374-8a9b-bba1be4d6553 response_code = 500 uri = /cockroachdb
9802024-06-25T07:09:19.663ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "66316175-3d9c-4374-8a9b-bba1be4d6553", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "66316175-3d9c-4374-8a9b-bba1be4d6553" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 7.208068657s
9812024-06-25T07:09:26.902ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 28275 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 1eb95c56-c94e-458b-bc0f-5396dfc234d6 response_code = 500 uri = /cockroachdb
9822024-06-25T07:09:26.902ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1eb95c56-c94e-458b-bc0f-5396dfc234d6", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1eb95c56-c94e-458b-bc0f-5396dfc234d6" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 8.99227284s
9832024-06-25T07:09:35.923ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27340 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 52d6325d-dd86-44dc-939a-d955c5b606ae response_code = 500 uri = /cockroachdb
9842024-06-25T07:09:35.923ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "52d6325d-dd86-44dc-939a-d955c5b606ae", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "52d6325d-dd86-44dc-939a-d955c5b606ae" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 7.885702965s
9852024-06-25T07:09:43.839ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_106fbba8-16ba-474f-bae5-20cf7d63514b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 28077 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = 58a4954a-6a2b-4eff-8c44-7cc4c4ab7ee4 response_code = 500 uri = /cockroachdb
9862024-06-25T07:09:43.839ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "58a4954a-6a2b-4eff-8c44-7cc4c4ab7ee4", "content-length": "124", "date": "Tue, 25 Jun 2024 07:09:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "58a4954a-6a2b-4eff-8c44-7cc4c4ab7ee4" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 10.38475111s
9872024-06-25T07:09:45.302ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39932
9882024-06-25T07:09:45.302ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:39932 req_id = e09522e3-ad12-4b31-ac1c-288a60199d0a response_code = 200 uri = /baseboard
9892024-06-25T07:09:54.252ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3367
9902024-06-25T07:09:56.537ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3385
9912024-06-25T07:09:59.007ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3408
9922024-06-25T07:09:59.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4782060 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:51156 req_id = e41ed068-1cd4-453a-a772-22a36d33d8e3 response_code = 204 uri = /cockroachdb
9932024-06-25T07:09:59.043ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 5db22e43-6365-46c5-b748-3751364244db, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3391e049-0617-4e88-8951-ec5bf4a53548, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: cd502136-0626-42c7-9766-0fc0993a655a, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 5894e109-b295-437e-8d83-5e590a8dbbe1, kind: Service { id: cd502136-0626-42c7-9766-0fc0993a655a }, name: Name("ntp-cd502136-0626-42c7-9766-0fc0993a655a"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 195, 46])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 908ccae6-e2ae-437f-97b1-6e34b094859a, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9b0df50c-c445-439e-90f5-eb10853e39c3, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 465eb41f-4880-4a29-95e7-b0fca4e4cb63, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External } } } }, OmicronZoneConfig { id: 6ce8da26-8d27-40ea-a3a2-49002174d50f, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External } } } }, OmicronZoneConfig { id: 106fbba8-16ba-474f-bae5-20cf7d63514b, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External } } } }, OmicronZoneConfig { id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 212011bd-1c29-4057-be32-2d2d45256d4a, kind: Service { id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd }, name: Name("external-dns-663f6433-2ca0-4fc1-899e-b6c962f7d0bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: bcea44c5-0687-4b95-a9f6-4d077176834e, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 57ff0e16-6252-4c77-9979-6e1fb5d6cc92, kind: Service { id: bcea44c5-0687-4b95-a9f6-4d077176834e }, name: Name("external-dns-bcea44c5-0687-4b95-a9f6-4d077176834e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 74])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 94aef47d-c355-463a-b987-9e3fb672eea0, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 74a27047-fbe2-465f-ad7e-89723ac0b01c, kind: Service { id: 94aef47d-c355-463a-b987-9e3fb672eea0 }, name: Name("nexus-94aef47d-c355-463a-b987-9e3fb672eea0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: d9135b4f-2200-4730-bcb9-64beda649f6d, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 3acee3d9-6047-479a-9bb5-045ee4d50428, kind: Service { id: d9135b4f-2200-4730-bcb9-64beda649f6d }, name: Name("nexus-d9135b4f-2200-4730-bcb9-64beda649f6d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 15])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8c9d931a-8357-4732-aa0e-9c884346c3d5, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 05643272-aead-47b3-a9d0-2cd6a6a16e37, kind: Service { id: 8c9d931a-8357-4732-aa0e-9c884346c3d5 }, name: Name("nexus-8c9d931a-8357-4732-aa0e-9c884346c3d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 554fce01-d20d-425b-9a18-d8204c20dc21, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: cc43f91b-6f57-4a50-b3db-e5458e01d395, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3bb92025-d495-4fc3-b035-e742c6afc1f7, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 916f47d1-877c-4b83-a4ff-f0c26c6d0627, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: e34dc54c-c6a6-46b2-8458-c5725fbb3a4b, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: eb19a03f-ba28-4d65-b463-2cf5f5bad7e1, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 905fdd4d-fdf4-47bc-acb2-bada755ae53e, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2aca2fb5-e853-456d-8bb9-a733193ba43b, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External } } } }, OmicronZoneConfig { id: 1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External } } } }, OmicronZoneConfig { id: 38f4497d-677f-461c-8af2-081c803530f1, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External } } } }, OmicronZoneConfig { id: bca2f6d5-deaf-4cab-99d4-445c444c649c, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: eba9a72e-79ea-4722-8854-b5f41ec1c20b (zpool), kind: External } } } }, OmicronZoneConfig { id: 87abff54-3579-4e31-9269-e565b3eda9c8, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf (zpool), kind: External } } } }, OmicronZoneConfig { id: 25369ac6-b521-48ea-b355-fb9df3ff070b, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6c00033c-63f1-47a0-8b42-6f61b082d646 (zpool), kind: External } } } }, OmicronZoneConfig { id: e2fa5cce-e1c0-421a-8a90-9ab618cea7b7, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6897e83c-187d-4573-a81f-bb7d6f202eb3 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
9942024-06-25T07:09:59.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36128
9952024-06-25T07:09:59.044ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5db22e43-6365-46c5-b748-3751364244db, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9962024-06-25T07:09:59.044ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5db22e43-6365-46c5-b748-3751364244db, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9972024-06-25T07:09:59.071ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9982024-06-25T07:09:59.071ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7eb07c85-ea8e-4595-8c41-c08f68268a21, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9992024-06-25T07:09:59.091ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3391e049-0617-4e88-8951-ec5bf4a53548, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
10002024-06-25T07:09:59.091ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3391e049-0617-4e88-8951-ec5bf4a53548, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: InternalDns }, responder: ... }
10012024-06-25T07:09:59.110ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 908ccae6-e2ae-437f-97b1-6e34b094859a, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
10022024-06-25T07:09:59.110ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 908ccae6-e2ae-437f-97b1-6e34b094859a, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
10032024-06-25T07:09:59.129ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9b0df50c-c445-439e-90f5-eb10853e39c3, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
10042024-06-25T07:09:59.129ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9b0df50c-c445-439e-90f5-eb10853e39c3, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
10052024-06-25T07:09:59.148ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 465eb41f-4880-4a29-95e7-b0fca4e4cb63, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
10062024-06-25T07:09:59.148ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 465eb41f-4880-4a29-95e7-b0fca4e4cb63, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: CockroachDb }, responder: ... }
10072024-06-25T07:09:59.168ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6ce8da26-8d27-40ea-a3a2-49002174d50f, dataset_name: DatasetName { pool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
10082024-06-25T07:09:59.168ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 6ce8da26-8d27-40ea-a3a2-49002174d50f, dataset_name: DatasetName { pool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External }, kind: CockroachDb }, responder: ... }
10092024-06-25T07:09:59.186ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 106fbba8-16ba-474f-bae5-20cf7d63514b, dataset_name: DatasetName { pool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
10102024-06-25T07:09:59.186ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 106fbba8-16ba-474f-bae5-20cf7d63514b, dataset_name: DatasetName { pool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
10112024-06-25T07:09:59.205ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
10122024-06-25T07:09:59.205ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10132024-06-25T07:09:59.268ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bcea44c5-0687-4b95-a9f6-4d077176834e, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
10142024-06-25T07:09:59.268ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: bcea44c5-0687-4b95-a9f6-4d077176834e, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10152024-06-25T07:09:59.330ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cc43f91b-6f57-4a50-b3db-e5458e01d395, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
10162024-06-25T07:09:59.331ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: cc43f91b-6f57-4a50-b3db-e5458e01d395, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10172024-06-25T07:09:59.393ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eb19a03f-ba28-4d65-b463-2cf5f5bad7e1, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10182024-06-25T07:09:59.393ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: eb19a03f-ba28-4d65-b463-2cf5f5bad7e1, dataset_name: DatasetName { pool_name: ZpoolName { id: 91a012db-ba8e-458f-bad0-85c50bdcfbd2 (zpool), kind: External }, kind: Crucible }, responder: ... }
10192024-06-25T07:09:59.455ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 905fdd4d-fdf4-47bc-acb2-bada755ae53e, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10202024-06-25T07:09:59.455ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 905fdd4d-fdf4-47bc-acb2-bada755ae53e, dataset_name: DatasetName { pool_name: ZpoolName { id: bd1f77a7-498c-47a0-8675-d771ae1ccef9 (zpool), kind: External }, kind: Crucible }, responder: ... }
10212024-06-25T07:09:59.511ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2aca2fb5-e853-456d-8bb9-a733193ba43b, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10222024-06-25T07:09:59.511ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2aca2fb5-e853-456d-8bb9-a733193ba43b, dataset_name: DatasetName { pool_name: ZpoolName { id: 9d857f30-656d-45b2-a37a-c31b060c8fae (zpool), kind: External }, kind: Crucible }, responder: ... }
10232024-06-25T07:09:59.578ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f, dataset_name: DatasetName { pool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10242024-06-25T07:09:59.579ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f, dataset_name: DatasetName { pool_name: ZpoolName { id: 73cdba2f-4771-4438-b5c3-84e7216dff0f (zpool), kind: External }, kind: Crucible }, responder: ... }
10252024-06-25T07:09:59.643ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 38f4497d-677f-461c-8af2-081c803530f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10262024-06-25T07:09:59.643ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 38f4497d-677f-461c-8af2-081c803530f1, dataset_name: DatasetName { pool_name: ZpoolName { id: 48b3c1a3-2c17-4973-8e17-8af9bebce768 (zpool), kind: External }, kind: Crucible }, responder: ... }
10272024-06-25T07:09:59.722ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: bca2f6d5-deaf-4cab-99d4-445c444c649c, dataset_name: DatasetName { pool_name: ZpoolName { id: eba9a72e-79ea-4722-8854-b5f41ec1c20b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10282024-06-25T07:09:59.722ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: bca2f6d5-deaf-4cab-99d4-445c444c649c, dataset_name: DatasetName { pool_name: ZpoolName { id: eba9a72e-79ea-4722-8854-b5f41ec1c20b (zpool), kind: External }, kind: Crucible }, responder: ... }
10292024-06-25T07:09:59.792ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 87abff54-3579-4e31-9269-e565b3eda9c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10302024-06-25T07:09:59.792ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 87abff54-3579-4e31-9269-e565b3eda9c8, dataset_name: DatasetName { pool_name: ZpoolName { id: 44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf (zpool), kind: External }, kind: Crucible }, responder: ... }
10312024-06-25T07:09:59.854ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 25369ac6-b521-48ea-b355-fb9df3ff070b, dataset_name: DatasetName { pool_name: ZpoolName { id: 6c00033c-63f1-47a0-8b42-6f61b082d646 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10322024-06-25T07:09:59.854ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 25369ac6-b521-48ea-b355-fb9df3ff070b, dataset_name: DatasetName { pool_name: ZpoolName { id: 6c00033c-63f1-47a0-8b42-6f61b082d646 (zpool), kind: External }, kind: Crucible }, responder: ... }
10332024-06-25T07:09:59.926ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e2fa5cce-e1c0-421a-8a90-9ab618cea7b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 6897e83c-187d-4573-a81f-bb7d6f202eb3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
10342024-06-25T07:09:59.926ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e2fa5cce-e1c0-421a-8a90-9ab618cea7b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 6897e83c-187d-4573-a81f-bb7d6f202eb3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10352024-06-25T07:09:59.996ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10362024-06-25T07:09:59.996ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/omicron-zones.json file = common/src/ledger.rs:177
10372024-06-25T07:09:59.997ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/omicron-zones.json file = common/src/ledger.rs:177
10382024-06-25T07:09:59.997ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10392024-06-25T07:10:00.100ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10402024-06-25T07:10:00.117ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10412024-06-25T07:10:00.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10422024-06-25T07:10:00.117ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10432024-06-25T07:10:00.156ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10442024-06-25T07:10:00.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10452024-06-25T07:10:00.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10462024-06-25T07:10:00.156ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10472024-06-25T07:10:00.171ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10482024-06-25T07:10:00.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10492024-06-25T07:10:00.197ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10502024-06-25T07:10:00.383ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
10512024-06-25T07:10:00.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10522024-06-25T07:10:00.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10532024-06-25T07:10:00.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10542024-06-25T07:10:00.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10552024-06-25T07:10:00.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10562024-06-25T07:10:00.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10572024-06-25T07:10:00.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10582024-06-25T07:10:00.412ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395 file = illumos-utils/src/zone.rs:315
10592024-06-25T07:10:00.418ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627 file = illumos-utils/src/zone.rs:315
10602024-06-25T07:10:00.423ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b file = illumos-utils/src/zone.rs:315
10612024-06-25T07:10:00.428ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e file = illumos-utils/src/zone.rs:315
10622024-06-25T07:10:00.433ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b file = illumos-utils/src/zone.rs:315
10632024-06-25T07:10:00.438ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1 file = illumos-utils/src/zone.rs:315
10642024-06-25T07:10:00.443ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1 file = illumos-utils/src/zone.rs:315
10652024-06-25T07:10:00.595ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395 file = illumos-utils/src/zone.rs:354
10662024-06-25T07:10:00.599ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627 file = illumos-utils/src/zone.rs:354
10672024-06-25T07:10:00.604ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b file = illumos-utils/src/zone.rs:354
10682024-06-25T07:10:00.609ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e file = illumos-utils/src/zone.rs:354
10692024-06-25T07:10:00.614ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b file = illumos-utils/src/zone.rs:354
10702024-06-25T07:10:00.620ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1 file = illumos-utils/src/zone.rs:354
10712024-06-25T07:10:00.625ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1 file = illumos-utils/src/zone.rs:354
10722024-06-25T07:10:00.630ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8 file = illumos-utils/src/zone.rs:315
10732024-06-25T07:10:00.636ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f file = illumos-utils/src/zone.rs:315
10742024-06-25T07:10:00.642ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b file = illumos-utils/src/zone.rs:315
10752024-06-25T07:10:00.648ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21 file = illumos-utils/src/zone.rs:315
10762024-06-25T07:10:00.654ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7 file = illumos-utils/src/zone.rs:315
10772024-06-25T07:10:00.660ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c file = illumos-utils/src/zone.rs:315
10782024-06-25T07:10:00.666ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7 file = illumos-utils/src/zone.rs:315
10792024-06-25T07:10:00.673ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8 file = illumos-utils/src/zone.rs:354
10802024-06-25T07:10:00.681ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f file = illumos-utils/src/zone.rs:354
10812024-06-25T07:10:00.688ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b file = illumos-utils/src/zone.rs:354
10822024-06-25T07:10:00.696ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21 file = illumos-utils/src/zone.rs:354
10832024-06-25T07:10:00.705ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7 file = illumos-utils/src/zone.rs:354
10842024-06-25T07:10:00.712ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c file = illumos-utils/src/zone.rs:354
10852024-06-25T07:10:00.718ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7 file = illumos-utils/src/zone.rs:354
10862024-06-25T07:10:00.817ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10872024-06-25T07:10:00.824ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
10882024-06-25T07:10:00.824ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
10892024-06-25T07:10:00.925ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 154, 65]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte1" } }
10902024-06-25T07:10:00.926ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = nexus
10912024-06-25T07:10:00.982ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10922024-06-25T07:10:01.038ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10932024-06-25T07:10:01.096ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10942024-06-25T07:10:01.176ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
10952024-06-25T07:10:01.181ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
10962024-06-25T07:10:01.181ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
10972024-06-25T07:10:01.299ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 144, 15]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte2" } }
10982024-06-25T07:10:01.299ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = nexus
10992024-06-25T07:10:01.304ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
11002024-06-25T07:10:01.304ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
11012024-06-25T07:10:01.406ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 238, 65]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte3" } }
11022024-06-25T07:10:01.406ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = external_dns
11032024-06-25T07:10:01.409ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
11042024-06-25T07:10:01.409ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
11052024-06-25T07:10:01.503ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 230, 74]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte4" } }
11062024-06-25T07:10:01.503ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = external_dns
11072024-06-25T07:10:01.505ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
11082024-06-25T07:10:01.505ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
11092024-06-25T07:10:01.592ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 169, 244]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte5" } }
11102024-06-25T07:10:01.592ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1190 zone_type = nexus
11112024-06-25T07:10:01.593ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
11122024-06-25T07:10:01.593ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
11132024-06-25T07:10:01.603ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
11142024-06-25T07:10:01.607ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11152024-06-25T07:10:01.983ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
11162024-06-25T07:10:01.983ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
11172024-06-25T07:10:01.983ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
11182024-06-25T07:10:01.983ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
11192024-06-25T07:10:01.983ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
11202024-06-25T07:10:01.983ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
11212024-06-25T07:10:01.984ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.1.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
11222024-06-25T07:10:01.984ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.1.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
11232024-06-25T07:10:01.984ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
11242024-06-25T07:10:01.988ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
11252024-06-25T07:10:01.992ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11262024-06-25T07:10:01.992ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11272024-06-25T07:10:01.992ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
11282024-06-25T07:10:01.995ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.1.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
11292024-06-25T07:10:01.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11302024-06-25T07:10:01.998ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
11312024-06-25T07:10:02.187ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0 file = illumos-utils/src/zone.rs:315
11322024-06-25T07:10:02.193ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d file = illumos-utils/src/zone.rs:315
11332024-06-25T07:10:02.201ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd file = illumos-utils/src/zone.rs:315
11342024-06-25T07:10:02.208ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e file = illumos-utils/src/zone.rs:315
11352024-06-25T07:10:02.215ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5 file = illumos-utils/src/zone.rs:315
11362024-06-25T07:10:02.223ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0 file = illumos-utils/src/zone.rs:354
11372024-06-25T07:10:02.230ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d file = illumos-utils/src/zone.rs:354
11382024-06-25T07:10:02.239ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd file = illumos-utils/src/zone.rs:354
11392024-06-25T07:10:02.247ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e file = illumos-utils/src/zone.rs:354
11402024-06-25T07:10:02.255ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5 file = illumos-utils/src/zone.rs:354
11412024-06-25T07:10:05.654ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11422024-06-25T07:10:05.655ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
11432024-06-25T07:10:05.678ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11442024-06-25T07:10:05.679ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11452024-06-25T07:10:05.679ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
11462024-06-25T07:10:05.694ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
11472024-06-25T07:10:07.440ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_bd1f77a7-498c-47a0-8675-d771ae1ccef9/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="f6884464-4dc0-440d-897e-f0bfd2626cc4"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11482024-06-25T07:10:07.441ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_9d857f30-656d-45b2-a37a-c31b060c8fae/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="6a326e07-3664-49db-b368-6bfa81e21d79"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11492024-06-25T07:10:07.444ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="51d5866b-2653-4840-8b33-14f0b63818ca"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11502024-06-25T07:10:07.444ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
11512024-06-25T07:10:07.462ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
11522024-06-25T07:10:07.486ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_91a012db-ba8e-458f-bad0-85c50bdcfbd2/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="769a92f0-cd63-40d0-a1cc-2c9f84c4cd96"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11532024-06-25T07:10:07.491ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_48b3c1a3-2c17-4973-8e17-8af9bebce768/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="1458e315-b5d9-44f8-90bc-ba4aa07176d7"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11542024-06-25T07:10:07.492ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
11552024-06-25T07:10:07.650ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_73cdba2f-4771-4438-b5c3-84e7216dff0f/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="09e06a51-4cfb-43e0-96e2-a027c89ff1f9"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11562024-06-25T07:10:07.660ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_6c00033c-63f1-47a0-8b42-6f61b082d646/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="82efec3a-a5c7-4724-be09-d7f051d264ad"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11572024-06-25T07:10:07.663ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_eba9a72e-79ea-4722-8854-b5f41ec1c20b/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="cb0af921-dde6-4527-8dee-4a6b700f9866"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11582024-06-25T07:10:07.672ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_6897e83c-187d-4573-a81f-bb7d6f202eb3/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="4a12e6fd-f6f2-4d08-823f-093867ba16ee"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11592024-06-25T07:10:07.676ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
11602024-06-25T07:10:07.728ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
11612024-06-25T07:10:07.737ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
11622024-06-25T07:10:07.766ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
11632024-06-25T07:10:07.850ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="554fce01-d20d-425b-9a18-d8204c20dc21"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11642024-06-25T07:10:07.850ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
11652024-06-25T07:10:07.860ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
11662024-06-25T07:10:07.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 26.115101ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
11672024-06-25T07:10:07.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 54.468108ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
11682024-06-25T07:10:07.890ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
11692024-06-25T07:10:07.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 61.857221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
11702024-06-25T07:10:07.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 117.140364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
11712024-06-25T07:10:07.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 95.949695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
11722024-06-25T07:10:08.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 118.169519ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
11732024-06-25T07:10:08.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 252.551185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
11742024-06-25T07:10:08.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 234.548907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
11752024-06-25T07:10:08.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 234.396794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
11762024-06-25T07:10:08.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 57.81336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
11772024-06-25T07:10:08.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 59.62481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
11782024-06-25T07:10:08.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 72.687049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
11792024-06-25T07:10:08.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 56.778925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
11802024-06-25T07:10:08.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 36.242078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
11812024-06-25T07:10:08.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 28.566666ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
11822024-06-25T07:10:08.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 50.81072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
11832024-06-25T07:10:08.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 65.65169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
11842024-06-25T07:10:08.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 59.525933ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
11852024-06-25T07:10:08.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 50.054467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
11862024-06-25T07:10:08.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 51.586909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
11872024-06-25T07:10:08.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 556.644434ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
11882024-06-25T07:10:08.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 425.975ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
11892024-06-25T07:10:08.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 107.539656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
11902024-06-25T07:10:08.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 79.702158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
11912024-06-25T07:10:08.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 32.486099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
11922024-06-25T07:10:08.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 135.231777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
11932024-06-25T07:10:08.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 92.624567ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
11942024-06-25T07:10:08.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 248.883829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
11952024-06-25T07:10:08.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 130.910964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
11962024-06-25T07:10:08.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 143.187882ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
11972024-06-25T07:10:08.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 581.958804ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
11982024-06-25T07:10:08.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 140.284364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
11992024-06-25T07:10:08.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 75.748074ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
12002024-06-25T07:10:08.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 312.163181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
12012024-06-25T07:10:09.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 203.440162ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
12022024-06-25T07:10:09.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 102.726094ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
12032024-06-25T07:10:09.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 197.177368ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
12042024-06-25T07:10:09.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 175.073612ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
12052024-06-25T07:10:09.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 289.361616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
12062024-06-25T07:10:09.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 217.870189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
12072024-06-25T07:10:09.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 235.498951ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
12082024-06-25T07:10:09.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.085399884s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
12092024-06-25T07:10:09.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 134.637866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
12102024-06-25T07:10:09.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 215.746602ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
12112024-06-25T07:10:09.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.075598685s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
12122024-06-25T07:10:09.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 537.036634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
12132024-06-25T07:10:09.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 895.618239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
12142024-06-25T07:10:09.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 390.873277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
12152024-06-25T07:10:09.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 221.921268ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
12162024-06-25T07:10:10.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 545.098896ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
12172024-06-25T07:10:10.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 349.361881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
12182024-06-25T07:10:10.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 524.749685ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
12192024-06-25T07:10:10.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 584.826982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
12202024-06-25T07:10:10.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 457.803296ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
12212024-06-25T07:10:10.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 297.883909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
12222024-06-25T07:10:10.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 989.894169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
12232024-06-25T07:10:10.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 501.683967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
12242024-06-25T07:10:10.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 835.706764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
12252024-06-25T07:10:10.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 912.44998ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
12262024-06-25T07:10:10.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 813.84687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
12272024-06-25T07:10:10.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.337873179s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
12282024-06-25T07:10:10.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.07193223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
12292024-06-25T07:10:10.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 497.076367ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
12302024-06-25T07:10:10.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 668.291534ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
12312024-06-25T07:10:12.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 520.823829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
12322024-06-25T07:10:13.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.353891408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
12332024-06-25T07:10:13.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 856.037436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
12342024-06-25T07:10:13.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 694.838168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
12352024-06-25T07:10:13.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.161308833s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
12362024-06-25T07:10:13.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.043563709s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
12372024-06-25T07:10:13.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 1.233639534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
12382024-06-25T07:10:13.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.196528083s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
12392024-06-25T07:10:13.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.300742801s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
12402024-06-25T07:10:13.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 916.804777ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
12412024-06-25T07:10:13.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.078183628s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
12422024-06-25T07:10:13.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 633.518719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
12432024-06-25T07:10:13.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 925.109481ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
12442024-06-25T07:10:13.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 658.101932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
12452024-06-25T07:10:13.801ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12462024-06-25T07:10:13.801ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
12472024-06-25T07:10:14.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 32.8512ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
12482024-06-25T07:10:14.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 130.783019ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
12492024-06-25T07:10:14.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 129.814972ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
12502024-06-25T07:10:14.330ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 958.198113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
12512024-06-25T07:10:14.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.400734131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
12522024-06-25T07:10:14.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 677.59025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
12532024-06-25T07:10:14.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 455.713203ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
12542024-06-25T07:10:14.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.154883226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
12552024-06-25T07:10:14.513ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12562024-06-25T07:10:14.513ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12572024-06-25T07:10:14.513ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12582024-06-25T07:10:14.513ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
12592024-06-25T07:10:14.521ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
12602024-06-25T07:10:14.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 709.859944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
12612024-06-25T07:10:14.544ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
12622024-06-25T07:10:14.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.022088517s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
12632024-06-25T07:10:14.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.343942334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
12642024-06-25T07:10:14.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 42.243609ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
12652024-06-25T07:10:14.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.36035675s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
12662024-06-25T07:10:14.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 71.991989ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
12672024-06-25T07:10:14.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 50.630244ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
12682024-06-25T07:10:14.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 98.739816ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
12692024-06-25T07:10:14.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 104.8027ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
12702024-06-25T07:10:14.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 59.042417ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
12712024-06-25T07:10:14.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 650.689546ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
12722024-06-25T07:10:14.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 794.668888ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
12732024-06-25T07:10:14.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 260.537872ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
12742024-06-25T07:10:14.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 1.176184844s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
12752024-06-25T07:10:14.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 213.460273ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
12762024-06-25T07:10:14.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 885.924968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
12772024-06-25T07:10:14.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 195.372483ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
12782024-06-25T07:10:14.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 1.386377781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
12792024-06-25T07:10:15.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 547.597587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
12802024-06-25T07:10:15.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.041557138s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
12812024-06-25T07:10:15.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 357.880214ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
12822024-06-25T07:10:15.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 361.544193ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
12832024-06-25T07:10:15.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 346.925265ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
12842024-06-25T07:10:15.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.01828083s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
12852024-06-25T07:10:15.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.373232287s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
12862024-06-25T07:10:15.471ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59500
12872024-06-25T07:10:15.472ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 525 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59500 req_id = f4993033-71a9-47af-9d42-af034d3d9e8d response_code = 200 uri = /baseboard
12882024-06-25T07:10:15.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 1.150684282s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
12892024-06-25T07:10:15.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.282069344s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
12902024-06-25T07:10:15.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 539.1246ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
12912024-06-25T07:10:15.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.155809064s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
12922024-06-25T07:10:15.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 691.920822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
12932024-06-25T07:10:15.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.254919942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
12942024-06-25T07:10:15.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 682.324111ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
12952024-06-25T07:10:15.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 712.807829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
12962024-06-25T07:10:15.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.152633864s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
12972024-06-25T07:10:15.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 941.942718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
12982024-06-25T07:10:16.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 878.878197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
12992024-06-25T07:10:16.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 1.101583207s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
13002024-06-25T07:10:16.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 895.263276ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
13012024-06-25T07:10:16.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.053034056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
13022024-06-25T07:10:16.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 697.052056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
13032024-06-25T07:10:16.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.161599978s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
13042024-06-25T07:10:16.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.431483252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
13052024-06-25T07:10:16.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 1.030259863s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
13062024-06-25T07:10:16.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 754.938839ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
13072024-06-25T07:10:16.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.267070273s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
13082024-06-25T07:10:16.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 951.538382ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
13092024-06-25T07:10:16.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 564.745536ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
13102024-06-25T07:10:16.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.142645375s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
13112024-06-25T07:10:16.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.133576125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
13122024-06-25T07:10:16.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 974.908668ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
13132024-06-25T07:10:16.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.138811569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
13142024-06-25T07:10:16.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.219754749s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
13152024-06-25T07:10:16.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 915.620802ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
13162024-06-25T07:10:16.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 576.85134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
13172024-06-25T07:10:17.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 672.509704ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
13182024-06-25T07:10:17.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 829.393547ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
13192024-06-25T07:10:17.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 903.386336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
13202024-06-25T07:10:17.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 922.173852ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
13212024-06-25T07:10:17.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 1.109083431s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
13222024-06-25T07:10:17.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 683.23043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
13232024-06-25T07:10:17.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.367853914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
13242024-06-25T07:10:17.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.130566396s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
13252024-06-25T07:10:17.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 773.020427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
13262024-06-25T07:10:17.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 673.502734ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
13272024-06-25T07:10:17.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 973.836838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
13282024-06-25T07:10:17.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 700.860822ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
13292024-06-25T07:10:17.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 700.136575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
13302024-06-25T07:10:17.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 768.642649ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
13312024-06-25T07:10:17.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.226727766s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
13322024-06-25T07:10:17.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.157745163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
13332024-06-25T07:10:18.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.253639929s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
13342024-06-25T07:10:18.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.121518984s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
13352024-06-25T07:10:18.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 981.491879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
13362024-06-25T07:10:18.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.483674215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
13372024-06-25T07:10:18.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 846.67229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
13382024-06-25T07:10:18.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 1.313559638s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
13392024-06-25T07:10:18.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 903.898871ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
13402024-06-25T07:10:18.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 1.195764538s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
13412024-06-25T07:10:18.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.052567354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
13422024-06-25T07:10:18.480ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.033709255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
13432024-06-25T07:10:18.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 733.248069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
13442024-06-25T07:10:18.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 836.396566ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
13452024-06-25T07:10:18.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.085080867s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
13462024-06-25T07:10:18.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.468736857s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
13472024-06-25T07:10:18.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.321679874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
13482024-06-25T07:10:19.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 599.822192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
13492024-06-25T07:10:19.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 1.420626526s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
13502024-06-25T07:10:19.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.416770235s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
13512024-06-25T07:10:19.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.398696962s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
13522024-06-25T07:10:19.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.365981602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
13532024-06-25T07:10:19.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.146140622s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
13542024-06-25T07:10:19.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 979.802259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
13552024-06-25T07:10:19.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 1.43111332s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
13562024-06-25T07:10:19.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 927.523772ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
13572024-06-25T07:10:19.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.344283584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
13582024-06-25T07:10:19.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.197568593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
13592024-06-25T07:10:19.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.07597197s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
13602024-06-25T07:10:19.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 531.817328ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
13612024-06-25T07:10:19.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 1.494228308s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
13622024-06-25T07:10:19.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.127534447s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
13632024-06-25T07:10:19.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.084794321s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
13642024-06-25T07:10:20.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 572.348419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
13652024-06-25T07:10:20.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 600.792565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
13662024-06-25T07:10:20.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.222117273s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
13672024-06-25T07:10:20.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.270311038s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
13682024-06-25T07:10:20.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 854.651168ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
13692024-06-25T07:10:20.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 1.320488844s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
13702024-06-25T07:10:20.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 514.771622ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
13712024-06-25T07:10:20.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 604.218337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
13722024-06-25T07:10:20.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 671.601448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
13732024-06-25T07:10:20.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 927.570042ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
13742024-06-25T07:10:20.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.461523644s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
13752024-06-25T07:10:20.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 605.727429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
13762024-06-25T07:10:20.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 714.102152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
13772024-06-25T07:10:20.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 693.463321ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
13782024-06-25T07:10:20.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.354808447s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
13792024-06-25T07:10:20.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 970.575656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
13802024-06-25T07:10:20.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.469815752s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
13812024-06-25T07:10:20.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.461715148s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
13822024-06-25T07:10:21.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 865.892987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
13832024-06-25T07:10:21.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 1.350696933s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
13842024-06-25T07:10:21.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 652.040304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
13852024-06-25T07:10:21.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 664.383505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
13862024-06-25T07:10:21.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.092165436s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
13872024-06-25T07:10:21.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.092218444s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
13882024-06-25T07:10:21.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 502.603956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
13892024-06-25T07:10:21.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 1.425536576s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
13902024-06-25T07:10:21.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.359522952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
13912024-06-25T07:10:21.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.271630671s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
13922024-06-25T07:10:21.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.099477874s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
13932024-06-25T07:10:21.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 1.22454519s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
13942024-06-25T07:10:21.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 522.638099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
13952024-06-25T07:10:21.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 990.161988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
13962024-06-25T07:10:21.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.489978918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
13972024-06-25T07:10:21.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 853.730899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
13982024-06-25T07:10:21.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.497547892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
13992024-06-25T07:10:22.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 683.277467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
14002024-06-25T07:10:22.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.199078781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
14012024-06-25T07:10:22.240ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14022024-06-25T07:10:22.241ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14032024-06-25T07:10:22.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 881.947077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
14042024-06-25T07:10:22.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.420561535s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
14052024-06-25T07:10:22.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.442887399s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
14062024-06-25T07:10:22.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.056695752s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
14072024-06-25T07:10:22.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.058328719s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
14082024-06-25T07:10:22.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 68.520685ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14092024-06-25T07:10:22.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 1.384677085s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
14102024-06-25T07:10:22.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 99.75098ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14112024-06-25T07:10:22.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 140.316151ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14122024-06-25T07:10:22.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.445642209s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
14132024-06-25T07:10:22.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.445330683s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
14142024-06-25T07:10:22.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.135486375s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
14152024-06-25T07:10:22.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 272.838845ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14162024-06-25T07:10:22.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 620.620305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
14172024-06-25T07:10:22.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 1.311499971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
14182024-06-25T07:10:22.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 683.578601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
14192024-06-25T07:10:22.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 883.393951ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
14202024-06-25T07:10:23.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 879.946164ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
14212024-06-25T07:10:23.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 883.226379ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14222024-06-25T07:10:23.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 727.795304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
14232024-06-25T07:10:23.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.204486322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
14242024-06-25T07:10:23.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 980.83156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
14252024-06-25T07:10:23.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.136968677s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
14262024-06-25T07:10:23.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.330501792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
14272024-06-25T07:10:23.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.40608523s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
14282024-06-25T07:10:23.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.028202893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
14292024-06-25T07:10:23.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.274081656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
14302024-06-25T07:10:23.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.440609788s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
14312024-06-25T07:10:23.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 917.059347ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
14322024-06-25T07:10:23.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.233854668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
14332024-06-25T07:10:23.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 728.140707ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
14342024-06-25T07:10:23.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 703.32604ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
14352024-06-25T07:10:23.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.183317776s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
14362024-06-25T07:10:23.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.21714492s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
14372024-06-25T07:10:23.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 1.112843219s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14382024-06-25T07:10:24.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 975.584958ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
14392024-06-25T07:10:24.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 612.646127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
14402024-06-25T07:10:24.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 613.565802ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
14412024-06-25T07:10:24.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.176872799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
14422024-06-25T07:10:24.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.259729122s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
14432024-06-25T07:10:24.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.358301579s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
14442024-06-25T07:10:24.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 630.109533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
14452024-06-25T07:10:24.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 980.771243ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
14462024-06-25T07:10:24.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 547.836606ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
14472024-06-25T07:10:24.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 1.28292703s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
14482024-06-25T07:10:24.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 562.5352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
14492024-06-25T07:10:24.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 940.003079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
14502024-06-25T07:10:24.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.227902107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
14512024-06-25T07:10:24.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.078789625s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
14522024-06-25T07:10:24.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 998.839065ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
14532024-06-25T07:10:25.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.247860507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
14542024-06-25T07:10:25.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 689.314057ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14552024-06-25T07:10:25.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.321569735s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
14562024-06-25T07:10:25.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.277914195s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
14572024-06-25T07:10:25.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.469410811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
14582024-06-25T07:10:25.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 942.134779ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
14592024-06-25T07:10:25.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 667.21173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
14602024-06-25T07:10:25.230ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14612024-06-25T07:10:25.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 799.688486ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
14622024-06-25T07:10:25.239ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
14632024-06-25T07:10:25.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 1.183652508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
14642024-06-25T07:10:25.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 45.726968ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
14652024-06-25T07:10:25.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 72.370755ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
14662024-06-25T07:10:25.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 278.989053ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
14672024-06-25T07:10:25.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.147715744s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
14682024-06-25T07:10:25.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 637.191427ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
14692024-06-25T07:10:25.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.029257794s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
14702024-06-25T07:10:25.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 527.184186ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14712024-06-25T07:10:25.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.05343774s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
14722024-06-25T07:10:25.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 443.447641ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
14732024-06-25T07:10:25.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 827.796369ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
14742024-06-25T07:10:25.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 511.553385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
14752024-06-25T07:10:25.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 530.567899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
14762024-06-25T07:10:25.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 856.828125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
14772024-06-25T07:10:26.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 990.060869ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
14782024-06-25T07:10:26.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.228227876s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
14792024-06-25T07:10:26.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 739.788848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
14802024-06-25T07:10:26.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 795.360105ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
14812024-06-25T07:10:26.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 1.429492574s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
14822024-06-25T07:10:26.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.1118858s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
14832024-06-25T07:10:26.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.174675912s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
14842024-06-25T07:10:26.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 1.211423403s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
14852024-06-25T07:10:26.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.126262383s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
14862024-06-25T07:10:26.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.32586444s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
14872024-06-25T07:10:26.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 958.939247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
14882024-06-25T07:10:26.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 533.099592ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
14892024-06-25T07:10:26.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 671.142474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
14902024-06-25T07:10:26.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 827.695365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
14912024-06-25T07:10:26.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.353316043s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
14922024-06-25T07:10:26.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 572.301408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
14932024-06-25T07:10:26.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.367666137s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
14942024-06-25T07:10:26.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.155536368s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
14952024-06-25T07:10:26.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.322845464s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
14962024-06-25T07:10:26.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.478849845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
14972024-06-25T07:10:26.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 756.083141ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
14982024-06-25T07:10:27.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 556.936149ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
14992024-06-25T07:10:27.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 750.327469ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
15002024-06-25T07:10:27.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 1.460302145s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
15012024-06-25T07:10:27.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 866.436985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
15022024-06-25T07:10:27.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 546.758083ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
15032024-06-25T07:10:27.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.097551164s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
15042024-06-25T07:10:27.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.38160417s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
15052024-06-25T07:10:27.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 884.711818ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
15062024-06-25T07:10:27.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.29280129s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
15072024-06-25T07:10:27.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 666.892442ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
15082024-06-25T07:10:27.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 1.444217687s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
15092024-06-25T07:10:27.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 810.830982ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
15102024-06-25T07:10:27.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 1.232096566s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
15112024-06-25T07:10:27.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 829.687324ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
15122024-06-25T07:10:27.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.127097034s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
15132024-06-25T07:10:27.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.284904858s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
15142024-06-25T07:10:27.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.269647931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
15152024-06-25T07:10:27.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 524.063152ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
15162024-06-25T07:10:28.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.357483029s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
15172024-06-25T07:10:28.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.450913918s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
15182024-06-25T07:10:28.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 776.677428ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
15192024-06-25T07:10:28.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 619.906133ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
15202024-06-25T07:10:28.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 620.477142ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
15212024-06-25T07:10:28.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 917.023417ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
15222024-06-25T07:10:28.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 790.463717ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
15232024-06-25T07:10:28.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 896.320055ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
15242024-06-25T07:10:28.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 907.932555ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
15252024-06-25T07:10:28.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 968.709021ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
15262024-06-25T07:10:28.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 1.360764109s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
15272024-06-25T07:10:28.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 805.563647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
15282024-06-25T07:10:28.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.488497802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
15292024-06-25T07:10:28.841ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 543.926239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
15302024-06-25T07:10:28.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.019714079s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
15312024-06-25T07:10:28.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.142135573s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
15322024-06-25T07:10:28.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 701.79994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
15332024-06-25T07:10:28.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 648.16335ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
15342024-06-25T07:10:28.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.087429843s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
15352024-06-25T07:10:29.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 733.456059ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
15362024-06-25T07:10:29.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.086378806s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
15372024-06-25T07:10:29.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 940.953861ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
15382024-06-25T07:10:29.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 615.905179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
15392024-06-25T07:10:29.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 807.408346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
15402024-06-25T07:10:29.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 1.412280247s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
15412024-06-25T07:10:29.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.18618019s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
15422024-06-25T07:10:29.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.362835933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
15432024-06-25T07:10:29.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.162490037s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
15442024-06-25T07:10:29.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.243544009s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
15452024-06-25T07:10:29.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 701.203985ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
15462024-06-25T07:10:29.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 654.062729ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
15472024-06-25T07:10:29.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.042737562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
15482024-06-25T07:10:29.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 926.828893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
15492024-06-25T07:10:29.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 733.313068ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
15502024-06-25T07:10:29.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.042969938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
15512024-06-25T07:10:29.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 921.577369ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
15522024-06-25T07:10:29.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 855.53831ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
15532024-06-25T07:10:30.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.198508617s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
15542024-06-25T07:10:30.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 840.338892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
15552024-06-25T07:10:30.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.141090753s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
15562024-06-25T07:10:30.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 575.967839ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
15572024-06-25T07:10:30.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 846.734204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
15582024-06-25T07:10:30.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 772.844848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
15592024-06-25T07:10:30.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 936.918952ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
15602024-06-25T07:10:30.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.086818712s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
15612024-06-25T07:10:30.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 712.627469ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
15622024-06-25T07:10:30.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 1.167137104s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
15632024-06-25T07:10:30.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.240707558s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
15642024-06-25T07:10:30.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 586.643513ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
15652024-06-25T07:10:30.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.081987562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
15662024-06-25T07:10:30.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 634.646059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
15672024-06-25T07:10:30.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.030993468s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
15682024-06-25T07:10:30.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 1.34378388s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
15692024-06-25T07:10:30.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 539.658154ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
15702024-06-25T07:10:30.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 1.478659435s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
15712024-06-25T07:10:30.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.094677906s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
15722024-06-25T07:10:30.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.475751678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
15732024-06-25T07:10:30.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.203120895s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
15742024-06-25T07:10:31.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 721.313711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
15752024-06-25T07:10:31.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.203280754s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
15762024-06-25T07:10:31.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 649.685945ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
15772024-06-25T07:10:31.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.419434258s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
15782024-06-25T07:10:31.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.15614846s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
15792024-06-25T07:10:31.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 1.006350255s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
15802024-06-25T07:10:31.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 629.504355ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
15812024-06-25T07:10:31.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.115594859s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
15822024-06-25T07:10:31.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 916.276757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
15832024-06-25T07:10:31.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7") failed: Property not found. retry in 1.123638191s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
15842024-06-25T07:10:31.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 879.173366ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
15852024-06-25T07:10:31.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 640.259404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
15862024-06-25T07:10:31.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.258136403s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
15872024-06-25T07:10:31.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 589.027561ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
15882024-06-25T07:10:31.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.451171514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
15892024-06-25T07:10:31.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 819.347078ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
15902024-06-25T07:10:31.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 1.068126328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
15912024-06-25T07:10:31.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 526.133004ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
15922024-06-25T07:10:32.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 1.005911072s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
15932024-06-25T07:10:32.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.139223899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
15942024-06-25T07:10:32.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 898.796281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
15952024-06-25T07:10:32.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 709.814454ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
15962024-06-25T07:10:32.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 992.081954ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
15972024-06-25T07:10:32.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 1.17891392s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
15982024-06-25T07:10:32.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627") failed: Property not found. retry in 1.057965118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
15992024-06-25T07:10:32.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 681.396458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
16002024-06-25T07:10:32.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 863.100992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
16012024-06-25T07:10:32.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 785.570707ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
16022024-06-25T07:10:32.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 932.783611ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16032024-06-25T07:10:32.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 751.774457ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
16042024-06-25T07:10:32.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 500.933898ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
16052024-06-25T07:10:32.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5") failed: Property not found. retry in 1.342163783s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
16062024-06-25T07:10:32.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e") failed: Property not found. retry in 1.384232205s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
16072024-06-25T07:10:32.916ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
16082024-06-25T07:10:33.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd") failed: Property not found. retry in 740.030777ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
16092024-06-25T07:10:33.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e") failed: Property not found. retry in 926.596902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
16102024-06-25T07:10:33.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b") failed: Property not found. retry in 1.037534594s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
16112024-06-25T07:10:33.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b") failed: Property not found. retry in 1.033002163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
16122024-06-25T07:10:33.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0") failed: Property not found. retry in 1.338087691s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
16132024-06-25T07:10:33.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f") failed: Property not found. retry in 706.585583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
16142024-06-25T07:10:33.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1") failed: Property not found. retry in 1.424732408s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
16152024-06-25T07:10:33.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21") failed: Property not found. retry in 1.14099866s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
16162024-06-25T07:10:33.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7") failed: Property not found. retry in 1.225912104s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
16172024-06-25T07:10:33.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1") failed: Property not found. retry in 1.388833649s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
16182024-06-25T07:10:33.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b") failed: Property not found. retry in 1.275596035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
16192024-06-25T07:10:33.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c") failed: Property not found. retry in 1.493081017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
16202024-06-25T07:10:33.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d") failed: Property not found. retry in 679.232133ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
16212024-06-25T07:10:33.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.475726371s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16222024-06-25T07:10:33.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8") failed: Property not found. retry in 546.484111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
16232024-06-25T07:10:34.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.285667386s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16242024-06-25T07:10:36.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.102959235s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16252024-06-25T07:10:36.381ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 130.942164447s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:423 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
16262024-06-25T07:10:37.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 951.877027ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16272024-06-25T07:10:38.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.480760451s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16282024-06-25T07:10:39.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.343153863s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16292024-06-25T07:10:41.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 918.430879ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16302024-06-25T07:10:42.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 952.608825ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16312024-06-25T07:10:43.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 1.234456954s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16322024-06-25T07:10:44.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395") failed: Property not found. retry in 892.832886ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16332024-06-25T07:10:45.214ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_nexus_94aef47d-c355-463a-b987-9e3fb672eea0
16342024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_clickhouse_cc43f91b-6f57-4a50-b3db-e5458e01d395
16352024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_pantry_916f47d1-877c-4b83-a4ff-f0c26c6d0627
16362024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_nexus_d9135b4f-2200-4730-bcb9-64beda649f6d
16372024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_pantry_e34dc54c-c6a6-46b2-8458-c5725fbb3a4b
16382024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_905fdd4d-fdf4-47bc-acb2-bada755ae53e
16392024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_2aca2fb5-e853-456d-8bb9-a733193ba43b
16402024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_external_dns_663f6433-2ca0-4fc1-899e-b6c962f7d0bd
16412024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_external_dns_bcea44c5-0687-4b95-a9f6-4d077176834e
16422024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_eb19a03f-ba28-4d65-b463-2cf5f5bad7e1
16432024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_38f4497d-677f-461c-8af2-081c803530f1
16442024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_87abff54-3579-4e31-9269-e565b3eda9c8
16452024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_1b3f76bb-0cff-4cac-a99f-d4d9156e8c6f
16462024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_25369ac6-b521-48ea-b355-fb9df3ff070b
16472024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_nexus_8c9d931a-8357-4732-aa0e-9c884346c3d5
16482024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_oximeter_554fce01-d20d-425b-9a18-d8204c20dc21
16492024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_pantry_3bb92025-d495-4fc3-b035-e742c6afc1f7
16502024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_bca2f6d5-deaf-4cab-99d4-445c444c649c
16512024-06-25T07:10:45.215ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2956 zone = oxz_crucible_e2fa5cce-e1c0-421a-8a90-9ab618cea7b7
16522024-06-25T07:10:45.217ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16532024-06-25T07:10:45.219ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16542024-06-25T07:10:45.223ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46178045 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36128 req_id = 6c150f4c-6236-4609-bf54-12f97a8f304b response_code = 204 uri = /omicron-zones
16552024-06-25T07:10:45.250ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1244
16562024-06-25T07:10:45.251ZINFOSledAgent (RSS): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16572024-06-25T07:10:45.251ZINFOSledAgent (RSS): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16582024-06-25T07:10:45.254ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:681
16592024-06-25T07:10:45.258ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:694
16602024-06-25T07:10:45.294ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:825
16612024-06-25T07:10:45.298ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c4040e58-1f95-4f0d-87ab-a992aa58e92b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
16622024-06-25T07:10:45.358ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c4040e58-1f95-4f0d-87ab-a992aa58e92b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
16632024-06-25T07:10:45.510ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48156
16642024-06-25T07:10:45.510ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48156 req_id = ab69e1a7-9d64-45ff-9290-8948fb339220 response_code = 200 uri = /baseboard
16652024-06-25T07:10:45.531ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c4040e58-1f95-4f0d-87ab-a992aa58e92b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
16662024-06-25T07:10:45.722ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c4040e58-1f95-4f0d-87ab-a992aa58e92b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
16672024-06-25T07:10:45.855ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c4040e58-1f95-4f0d-87ab-a992aa58e92b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
16682024-06-25T07:10:46.017ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c4040e58-1f95-4f0d-87ab-a992aa58e92b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
16692024-06-25T07:10:46.200ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/c4040e58-1f95-4f0d-87ab-a992aa58e92b/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
16702024-06-25T07:10:46.393ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 403 Forbidden; headers: {"content-type": "application/json", "x-request-id": "5e2e07ee-d032-4c5d-9f68-ad791dd6f629", "content-length": "113", "date": "Tue, 25 Jun 2024 07:10:46 GMT"}; value: Error { error_code: Some("Forbidden"), message: "Forbidden", request_id: "5e2e07ee-d032-4c5d-9f68-ad791dd6f629" } file = sled-agent/src/rack_setup/service.rs:887
16712024-06-25T07:10:46.661ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f2a9730b-e80d-4db0-a531-79bea19540d7", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"c4040e58-1f95-4f0d-87ab-a992aa58e92b\"", request_id: "f2a9730b-e80d-4db0-a531-79bea19540d7" } file = sled-agent/src/rack_setup/service.rs:887
16722024-06-25T07:10:47.591ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8780e98c-40fd-4869-9ab6-291bec66c103", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "8780e98c-40fd-4869-9ab6-291bec66c103" } file = sled-agent/src/rack_setup/service.rs:887
16732024-06-25T07:10:48.504ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "86707ad7-d431-4df5-b159-597a32406fe9", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "86707ad7-d431-4df5-b159-597a32406fe9" } file = sled-agent/src/rack_setup/service.rs:887
16742024-06-25T07:10:49.276ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6e8516de-a491-4196-a328-e444d0e1a9c3", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "6e8516de-a491-4196-a328-e444d0e1a9c3" } file = sled-agent/src/rack_setup/service.rs:887
16752024-06-25T07:10:50.131ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2c115703-0919-45a5-a9ae-c544cefd18b7", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "2c115703-0919-45a5-a9ae-c544cefd18b7" } file = sled-agent/src/rack_setup/service.rs:887
16762024-06-25T07:10:51.154ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e98c08c5-e97e-4200-8284-71287b6528b1", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "e98c08c5-e97e-4200-8284-71287b6528b1" } file = sled-agent/src/rack_setup/service.rs:887
16772024-06-25T07:10:52.511ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e8c909a6-c135-4940-9166-c7a8d0e7a70f", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:52 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "e8c909a6-c135-4940-9166-c7a8d0e7a70f" } file = sled-agent/src/rack_setup/service.rs:887
16782024-06-25T07:10:53.691ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9f7a9c15-e74f-4637-9778-5ad08a4aa6af", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "9f7a9c15-e74f-4637-9778-5ad08a4aa6af" } file = sled-agent/src/rack_setup/service.rs:887
16792024-06-25T07:10:55.839ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "fd35e5a6-6c85-412e-ac72-12ef632198d7", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "fd35e5a6-6c85-412e-ac72-12ef632198d7" } file = sled-agent/src/rack_setup/service.rs:887
16802024-06-25T07:10:57.616ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "486ea7b0-a508-4f28-a08c-53d7c7f0d600", "content-length": "173", "date": "Tue, 25 Jun 2024 07:10:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "486ea7b0-a508-4f28-a08c-53d7c7f0d600" } file = sled-agent/src/rack_setup/service.rs:887
16812024-06-25T07:11:00.958ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9910715e-fa33-44e0-af7b-7a574ea301c5", "content-length": "173", "date": "Tue, 25 Jun 2024 07:11:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "9910715e-fa33-44e0-af7b-7a574ea301c5" } file = sled-agent/src/rack_setup/service.rs:887
16822024-06-25T07:11:04.488ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "57b0096d-9df5-471a-a95e-5a8326b10e62", "content-length": "173", "date": "Tue, 25 Jun 2024 07:11:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "57b0096d-9df5-471a-a95e-5a8326b10e62" } file = sled-agent/src/rack_setup/service.rs:887
16832024-06-25T07:11:07.823ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0dbd27a3-b33a-4142-9c0c-c02dff5e3d7d", "content-length": "173", "date": "Tue, 25 Jun 2024 07:11:07 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "0dbd27a3-b33a-4142-9c0c-c02dff5e3d7d" } file = sled-agent/src/rack_setup/service.rs:887
16842024-06-25T07:11:11.546ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "79199369-5ef6-448d-aec8-3a67264ff66e", "content-length": "173", "date": "Tue, 25 Jun 2024 07:11:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"6ec53d70-2eff-4360-abaf-e88d5a5744b1\"", request_id: "79199369-5ef6-448d-aec8-3a67264ff66e" } file = sled-agent/src/rack_setup/service.rs:887
16852024-06-25T07:11:14.368ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
16862024-06-25T07:11:14.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43731
16872024-06-25T07:11:14.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
16882024-06-25T07:11:14.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 85504 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43731 req_id = 3f893e23-3f41-40a3-aae6-9ac87aadc860 response_code = 200 uri = /inventory
16892024-06-25T07:11:14.582ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
16902024-06-25T07:11:14.582ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/omicron-zones.json file = common/src/ledger.rs:177
16912024-06-25T07:11:14.583ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/omicron-zones.json file = common/src/ledger.rs:177
16922024-06-25T07:11:14.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 2403 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43731 req_id = 6f0e9bb9-45ba-4c4c-87c9-284b3df67d0f response_code = 200 uri = /omicron-zones
16932024-06-25T07:11:15.546ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34574
16942024-06-25T07:11:15.546ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 70 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34574 req_id = 48ee713b-756e-4af7-8fa7-d00b85ea8588 response_code = 200 uri = /baseboard
16952024-06-25T07:11:15.970ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56895
16962024-06-25T07:11:15.972ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 212011bd-1c29-4057-be32-2d2d45256d4a, kind: Service { id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd }, name: Name("external-dns-663f6433-2ca0-4fc1-899e-b6c962f7d0bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 57ff0e16-6252-4c77-9979-6e1fb5d6cc92, kind: Service { id: bcea44c5-0687-4b95-a9f6-4d077176834e }, name: Name("external-dns-bcea44c5-0687-4b95-a9f6-4d077176834e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 74])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05643272-aead-47b3-a9d0-2cd6a6a16e37, kind: Service { id: 8c9d931a-8357-4732-aa0e-9c884346c3d5 }, name: Name("nexus-8c9d931a-8357-4732-aa0e-9c884346c3d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 3acee3d9-6047-479a-9bb5-045ee4d50428, kind: Service { id: d9135b4f-2200-4730-bcb9-64beda649f6d }, name: Name("nexus-d9135b4f-2200-4730-bcb9-64beda649f6d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 15])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 74a27047-fbe2-465f-ad7e-89723ac0b01c, kind: Service { id: 94aef47d-c355-463a-b987-9e3fb672eea0 }, name: Name("nexus-94aef47d-c355-463a-b987-9e3fb672eea0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16972024-06-25T07:11:15.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16982024-06-25T07:11:15.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16992024-06-25T07:11:15.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17002024-06-25T07:11:15.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17012024-06-25T07:11:15.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17022024-06-25T07:11:15.972ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17032024-06-25T07:11:15.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1688 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56895 req_id = d12d3800-be8f-4afc-947b-0ec8080832e7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17042024-06-25T07:11:15.975ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:897
17052024-06-25T07:11:16.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38719
17062024-06-25T07:11:16.122ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17072024-06-25T07:11:16.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 87221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38719 req_id = dbfa942d-e30c-4283-a2c5-b008d14993af response_code = 200 uri = /inventory
17082024-06-25T07:11:16.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17092024-06-25T07:11:16.210ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/config/omicron-zones.json file = common/src/ledger.rs:177
17102024-06-25T07:11:16.211ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/config/omicron-zones.json file = common/src/ledger.rs:177
17112024-06-25T07:11:16.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38719 req_id = 31e23c4a-7fd1-4ef7-b012-7f0faf2471af response_code = 200 uri = /omicron-zones
17122024-06-25T07:11:16.496ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48345
17132024-06-25T07:11:16.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1832 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48345 req_id = ad51b560-f684-4a70-b738-217292bb6640 response_code = 200 uri = /v2p
17142024-06-25T07:11:16.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50369
17152024-06-25T07:11:16.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50369 req_id = 52fc70d1-36b9-479b-b44d-157233d36c29 response_code = 200 uri = /v2p
17162024-06-25T07:11:16.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44645
17172024-06-25T07:11:16.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44645 req_id = 2619cfac-994e-481e-8876-e421ee98f4a1 response_code = 200 uri = /v2p
17182024-06-25T07:11:16.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56769
17192024-06-25T07:11:16.729ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 212011bd-1c29-4057-be32-2d2d45256d4a, kind: Service { id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd }, name: Name("external-dns-663f6433-2ca0-4fc1-899e-b6c962f7d0bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 57ff0e16-6252-4c77-9979-6e1fb5d6cc92, kind: Service { id: bcea44c5-0687-4b95-a9f6-4d077176834e }, name: Name("external-dns-bcea44c5-0687-4b95-a9f6-4d077176834e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 74])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05643272-aead-47b3-a9d0-2cd6a6a16e37, kind: Service { id: 8c9d931a-8357-4732-aa0e-9c884346c3d5 }, name: Name("nexus-8c9d931a-8357-4732-aa0e-9c884346c3d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 3acee3d9-6047-479a-9bb5-045ee4d50428, kind: Service { id: d9135b4f-2200-4730-bcb9-64beda649f6d }, name: Name("nexus-d9135b4f-2200-4730-bcb9-64beda649f6d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 15])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 74a27047-fbe2-465f-ad7e-89723ac0b01c, kind: Service { id: 94aef47d-c355-463a-b987-9e3fb672eea0 }, name: Name("nexus-94aef47d-c355-463a-b987-9e3fb672eea0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17202024-06-25T07:11:16.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17212024-06-25T07:11:16.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17222024-06-25T07:11:16.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17232024-06-25T07:11:16.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17242024-06-25T07:11:16.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17252024-06-25T07:11:16.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17262024-06-25T07:11:16.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 605 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56769 req_id = 42bcdf16-2cfc-46cb-9cfc-71c8a26e7d7f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17272024-06-25T07:11:16.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42587
17282024-06-25T07:11:16.763ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 212011bd-1c29-4057-be32-2d2d45256d4a, kind: Service { id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd }, name: Name("external-dns-663f6433-2ca0-4fc1-899e-b6c962f7d0bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 57ff0e16-6252-4c77-9979-6e1fb5d6cc92, kind: Service { id: bcea44c5-0687-4b95-a9f6-4d077176834e }, name: Name("external-dns-bcea44c5-0687-4b95-a9f6-4d077176834e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 74])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05643272-aead-47b3-a9d0-2cd6a6a16e37, kind: Service { id: 8c9d931a-8357-4732-aa0e-9c884346c3d5 }, name: Name("nexus-8c9d931a-8357-4732-aa0e-9c884346c3d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 3acee3d9-6047-479a-9bb5-045ee4d50428, kind: Service { id: d9135b4f-2200-4730-bcb9-64beda649f6d }, name: Name("nexus-d9135b4f-2200-4730-bcb9-64beda649f6d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 15])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 74a27047-fbe2-465f-ad7e-89723ac0b01c, kind: Service { id: 94aef47d-c355-463a-b987-9e3fb672eea0 }, name: Name("nexus-94aef47d-c355-463a-b987-9e3fb672eea0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17292024-06-25T07:11:16.763ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17302024-06-25T07:11:16.763ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17312024-06-25T07:11:16.763ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17322024-06-25T07:11:16.763ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17332024-06-25T07:11:16.763ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17342024-06-25T07:11:16.763ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17352024-06-25T07:11:16.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 385 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42587 req_id = 6ad5dd6f-82d3-4894-a396-5dc94db4a340 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17362024-06-25T07:11:16.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34118
17372024-06-25T07:11:16.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 97117 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34118 req_id = d7116b49-4460-49aa-81d1-236195f9c8f2 response_code = 204 uri = /switch-ports
17382024-06-25T07:11:16.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62745
17392024-06-25T07:11:16.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64900
17402024-06-25T07:11:16.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42092
17412024-06-25T07:11:16.873ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 212011bd-1c29-4057-be32-2d2d45256d4a, kind: Service { id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd }, name: Name("external-dns-663f6433-2ca0-4fc1-899e-b6c962f7d0bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 57ff0e16-6252-4c77-9979-6e1fb5d6cc92, kind: Service { id: bcea44c5-0687-4b95-a9f6-4d077176834e }, name: Name("external-dns-bcea44c5-0687-4b95-a9f6-4d077176834e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 74])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05643272-aead-47b3-a9d0-2cd6a6a16e37, kind: Service { id: 8c9d931a-8357-4732-aa0e-9c884346c3d5 }, name: Name("nexus-8c9d931a-8357-4732-aa0e-9c884346c3d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 3acee3d9-6047-479a-9bb5-045ee4d50428, kind: Service { id: d9135b4f-2200-4730-bcb9-64beda649f6d }, name: Name("nexus-d9135b4f-2200-4730-bcb9-64beda649f6d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 15])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 74a27047-fbe2-465f-ad7e-89723ac0b01c, kind: Service { id: 94aef47d-c355-463a-b987-9e3fb672eea0 }, name: Name("nexus-94aef47d-c355-463a-b987-9e3fb672eea0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17422024-06-25T07:11:16.873ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17432024-06-25T07:11:16.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34118 req_id = 7977e6d3-c1cc-4395-b47c-fc9a70efc1a3 response_code = 200 uri = /network-bootstore-config
17442024-06-25T07:11:16.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17452024-06-25T07:11:16.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17462024-06-25T07:11:16.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17472024-06-25T07:11:16.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17482024-06-25T07:11:16.874ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17492024-06-25T07:11:16.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3921 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64900 req_id = 29a3eec2-4143-4a76-9d4e-b2d056d46b78 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17502024-06-25T07:11:16.895ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17512024-06-25T07:11:16.895ZINFOSledAgent (bootstore): Writing ledger to /pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17522024-06-25T07:11:16.896ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17532024-06-25T07:11:16.897ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17542024-06-25T07:11:16.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34118 req_id = f3e1358a-4252-4876-a7d4-85bce2110860 response_code = 204 uri = /network-bootstore-config
17552024-06-25T07:11:16.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 56930 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62745 req_id = 91225eec-af09-4c64-9a42-2b095140baeb response_code = 204 uri = /switch-ports
17562024-06-25T07:11:16.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1064 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62745 req_id = 5a25820e-3cf4-4c44-a114-f59f01be3e2f response_code = 200 uri = /network-bootstore-config
17572024-06-25T07:11:16.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 107620 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42092 req_id = 39d3f247-eb7c-40fd-af6d-d6305c86dd14 response_code = 204 uri = /switch-ports
17582024-06-25T07:11:16.978ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42092 req_id = d66d34ac-25f9-4975-94b7-9a40451ed826 response_code = 200 uri = /network-bootstore-config
17592024-06-25T07:11:45.588ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64756
17602024-06-25T07:11:45.588ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 128 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64756 req_id = ffa3817b-8136-4aea-bba7-a56ebaa32026 response_code = 200 uri = /baseboard
17612024-06-25T07:11:46.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58223
17622024-06-25T07:11:46.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1683 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58223 req_id = c3034e8b-1211-4e18-b050-5aae5b586b19 response_code = 200 uri = /v2p
17632024-06-25T07:11:46.535ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33652
17642024-06-25T07:11:46.535ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33652 req_id = b9b28855-2dba-4c0e-b8a2-74f558c7b12d response_code = 200 uri = /v2p
17652024-06-25T07:11:46.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49347
17662024-06-25T07:11:46.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49347 req_id = 29ae7af0-25c0-4d60-8ab1-db2b323d0d3d response_code = 200 uri = /v2p
17672024-06-25T07:11:46.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46237
17682024-06-25T07:11:46.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46972 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46237 req_id = 08a6e9b0-21d7-4b96-a11c-c03abc51bc03 response_code = 204 uri = /switch-ports
17692024-06-25T07:11:46.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34937
17702024-06-25T07:11:46.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 924 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46237 req_id = 08028362-3fe6-4c35-a6fe-f0cf5704e0c5 response_code = 200 uri = /network-bootstore-config
17712024-06-25T07:11:46.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47101 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34937 req_id = 10a9a20b-a9bd-486c-be37-7397404e4b8b response_code = 204 uri = /switch-ports
17722024-06-25T07:11:46.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34937 req_id = 50ccc46b-187b-4dd9-880b-7425e179e703 response_code = 200 uri = /network-bootstore-config
17732024-06-25T07:11:46.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47700
17742024-06-25T07:11:46.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42916 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47700 req_id = 70af906c-e016-48a4-a60b-41ba9afdaf6e response_code = 204 uri = /switch-ports
17752024-06-25T07:11:46.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47700 req_id = d81a6797-6f36-42e6-9d41-19a6c6047d3e response_code = 200 uri = /network-bootstore-config
17762024-06-25T07:12:15.628ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43099
17772024-06-25T07:12:15.628ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43099 req_id = a2293771-2d15-40e1-a221-bbf481067f03 response_code = 200 uri = /baseboard
17782024-06-25T07:12:16.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51950
17792024-06-25T07:12:16.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 387 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51950 req_id = 7492c813-ecdd-43aa-84bf-d06945a465bf response_code = 200 uri = /v2p
17802024-06-25T07:12:16.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36804
17812024-06-25T07:12:16.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36804 req_id = 15d2f92d-1671-4f97-83e7-be80a29dff5f response_code = 200 uri = /v2p
17822024-06-25T07:12:16.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52222
17832024-06-25T07:12:16.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52222 req_id = 21851b2f-3683-4e8a-9750-51fbc87df307 response_code = 200 uri = /v2p
17842024-06-25T07:12:16.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55288
17852024-06-25T07:12:16.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50109 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55288 req_id = 956cf983-fcf8-42e1-9e6b-c8b051279f67 response_code = 204 uri = /switch-ports
17862024-06-25T07:12:16.542ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54795
17872024-06-25T07:12:16.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48353 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54795 req_id = 9a2730e3-8728-467e-879a-f1a24e6d72f3 response_code = 204 uri = /switch-ports
17882024-06-25T07:12:16.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55288 req_id = 62ed84d3-3c10-43a7-8c28-620f3bbd71c4 response_code = 200 uri = /network-bootstore-config
17892024-06-25T07:12:16.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54795 req_id = 386a5bf1-d9e2-4231-bc85-1e15e9c40bff response_code = 200 uri = /network-bootstore-config
17902024-06-25T07:12:16.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40645
17912024-06-25T07:12:16.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45893 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40645 req_id = f9032ba5-059e-422d-b367-e3562885dd1b response_code = 204 uri = /switch-ports
17922024-06-25T07:12:16.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40645 req_id = 5983a409-2818-4d7d-949a-3ae95d533f82 response_code = 200 uri = /network-bootstore-config
17932024-06-25T07:12:45.661ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41762
17942024-06-25T07:12:45.661ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 650 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:41762 req_id = 03334772-8c01-4b16-a219-c5b51d3d2195 response_code = 200 uri = /baseboard
17952024-06-25T07:12:46.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51786
17962024-06-25T07:12:46.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51786 req_id = fdc948f6-d276-41d2-a910-e24a9967a1d0 response_code = 200 uri = /v2p
17972024-06-25T07:12:46.525ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64545
17982024-06-25T07:12:46.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1020 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64545 req_id = 6766dc63-4c96-4f54-bba4-30572ca02947 response_code = 200 uri = /v2p
17992024-06-25T07:12:46.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61209
18002024-06-25T07:12:46.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61209 req_id = 72cf8f60-9b45-4ae4-a7e6-b7fa4a60156f response_code = 200 uri = /v2p
18012024-06-25T07:12:46.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52013
18022024-06-25T07:12:46.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43871 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52013 req_id = 17d906b2-fb6f-48d0-a08b-4367f5aa9dd5 response_code = 204 uri = /switch-ports
18032024-06-25T07:12:46.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38682
18042024-06-25T07:12:46.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60101
18052024-06-25T07:12:46.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52013 req_id = dacd2b3d-5f14-481f-b7c9-afd0f673190c response_code = 200 uri = /network-bootstore-config
18062024-06-25T07:12:46.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 41932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38682 req_id = 249a9696-d9e7-483b-b08c-0310b84271b0 response_code = 204 uri = /switch-ports
18072024-06-25T07:12:46.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1049 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38682 req_id = 02d8eacf-f724-4617-8fc2-c7f4a160dbef response_code = 200 uri = /network-bootstore-config
18082024-06-25T07:12:46.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 83325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60101 req_id = 5af04cdb-e71f-4c5d-af60-dc1e046df4f3 response_code = 204 uri = /switch-ports
18092024-06-25T07:12:46.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60101 req_id = c127da16-8fd0-4063-a8a3-602b9f6e97ad response_code = 200 uri = /network-bootstore-config
18102024-06-25T07:13:15.694ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42768
18112024-06-25T07:13:15.694ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 95 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42768 req_id = 494e0b46-b0d2-489d-80b5-d6defe4d0cef response_code = 200 uri = /baseboard
18122024-06-25T07:13:16.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43219
18132024-06-25T07:13:16.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43219 req_id = 719be058-92a0-4227-bc23-d188e27a6f2b response_code = 200 uri = /v2p
18142024-06-25T07:13:16.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36185
18152024-06-25T07:13:16.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 875 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36185 req_id = c689dabb-6c7f-4550-b32b-127194a50b28 response_code = 200 uri = /v2p
18162024-06-25T07:13:16.485ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42660
18172024-06-25T07:13:16.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42660 req_id = fda1a4ce-22a3-4a1a-9454-db53ef53f5bf response_code = 200 uri = /v2p
18182024-06-25T07:13:16.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55153
18192024-06-25T07:13:16.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46190 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55153 req_id = 6e19a72d-26c5-4bb4-b133-34e03598e7c7 response_code = 204 uri = /switch-ports
18202024-06-25T07:13:16.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55153 req_id = 73188c08-810b-4f00-a66c-9fcb45fc8915 response_code = 200 uri = /network-bootstore-config
18212024-06-25T07:13:16.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37129
18222024-06-25T07:13:16.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43217 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37129 req_id = 14bf938f-fe92-47d8-9a17-3f40480bec20 response_code = 204 uri = /switch-ports
18232024-06-25T07:13:16.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37129 req_id = e8d7138d-b088-4937-b81f-4ae1564535d6 response_code = 200 uri = /network-bootstore-config
18242024-06-25T07:13:16.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34622
18252024-06-25T07:13:16.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34622 req_id = 0638d5fa-e447-4488-9405-80aff02fefd4 response_code = 204 uri = /switch-ports
18262024-06-25T07:13:16.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34622 req_id = d548cbfc-9542-4dac-a268-ebe73e2c4578 response_code = 200 uri = /network-bootstore-config
18272024-06-25T07:13:17.485ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:34584 remote_addr = [fd00:1122:3344:101::d]:47281 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1
18282024-06-25T07:13:17.508ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 23103 local_addr = [fd00:1122:3344:101::1]:34584 method = GET remote_addr = [fd00:1122:3344:101::d]:47281 req_id = 294a3796-5603-4639-9ee6-5158c2dbe3b3 response_code = 200 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 uri = /6ec53d70-2eff-4360-abaf-e88d5a5744b1
18292024-06-25T07:13:45.728ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44856
18302024-06-25T07:13:45.728ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 69 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44856 req_id = 1d8ccbbd-135c-49bf-b4ae-3ee0d2b0c2ed response_code = 200 uri = /baseboard
18312024-06-25T07:13:46.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62210
18322024-06-25T07:13:46.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62210 req_id = bf12758d-9f59-4886-a2dc-ea3e9c2dcbfd response_code = 200 uri = /v2p
18332024-06-25T07:13:46.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57880
18342024-06-25T07:13:46.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57880 req_id = 61f4713a-b642-4350-b1c4-6f09034e9e55 response_code = 200 uri = /v2p
18352024-06-25T07:13:46.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60227
18362024-06-25T07:13:46.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 978 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60227 req_id = 1127e3ae-36f7-4205-9159-6a78df65616f response_code = 200 uri = /v2p
18372024-06-25T07:13:46.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42548
18382024-06-25T07:13:46.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45706 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42548 req_id = 40c2ee8d-4767-43f0-b0bc-36874143de68 response_code = 204 uri = /switch-ports
18392024-06-25T07:13:46.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48204
18402024-06-25T07:13:46.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42548 req_id = 063c1296-0b3c-493b-8a59-52139ddfc626 response_code = 200 uri = /network-bootstore-config
18412024-06-25T07:13:46.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44873 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48204 req_id = 6f7d67e0-f786-4b87-ba77-655e10fad709 response_code = 204 uri = /switch-ports
18422024-06-25T07:13:46.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 873 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48204 req_id = 2448629e-d54a-429a-828b-f3f1063502c2 response_code = 200 uri = /network-bootstore-config
18432024-06-25T07:13:46.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58306
18442024-06-25T07:13:46.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48027 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58306 req_id = 2ecabdd4-0ab8-4069-9f51-dc7f0a7566e8 response_code = 204 uri = /switch-ports
18452024-06-25T07:13:46.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 749 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58306 req_id = c7c37036-a0e8-4a49-aa63-55ddc9095dd6 response_code = 200 uri = /network-bootstore-config
18462024-06-25T07:13:47.485ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1004 local_addr = [fd00:1122:3344:101::1]:34584 method = GET remote_addr = [fd00:1122:3344:101::d]:47281 req_id = 52a64d86-c4a4-4f9c-b000-94515f42c8bc response_code = 200 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 uri = /6ec53d70-2eff-4360-abaf-e88d5a5744b1
18472024-06-25T07:14:15.760ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35453
18482024-06-25T07:14:15.760ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 529 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35453 req_id = 736553d1-3b36-4a0a-9c2a-0b77aee034b8 response_code = 200 uri = /baseboard
18492024-06-25T07:14:16.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60546
18502024-06-25T07:14:16.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60546 req_id = 73dae573-3c5e-43a6-b7d4-88321003933e response_code = 200 uri = /v2p
18512024-06-25T07:14:16.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61025
18522024-06-25T07:14:16.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61025 req_id = 33a82cac-dc8a-4914-8454-c36854ad4069 response_code = 200 uri = /v2p
18532024-06-25T07:14:16.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51739
18542024-06-25T07:14:16.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47758 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51739 req_id = 0325a227-6894-4d74-b3f0-faa3843a6df4 response_code = 204 uri = /switch-ports
18552024-06-25T07:14:16.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41583
18562024-06-25T07:14:16.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 754 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41583 req_id = 0869486b-155c-4b56-a3f6-79a14557069a response_code = 200 uri = /v2p
18572024-06-25T07:14:16.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51739 req_id = 9208eadd-f65d-4567-8799-337107d3f7cb response_code = 200 uri = /network-bootstore-config
18582024-06-25T07:14:16.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49764
18592024-06-25T07:14:16.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44342 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49764 req_id = a555f268-1850-4ebc-a595-4a3415231c79 response_code = 204 uri = /switch-ports
18602024-06-25T07:14:16.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51753
18612024-06-25T07:14:16.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 2809 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49764 req_id = c05f7c7a-dec0-4c6a-b494-3ff966776ca1 response_code = 200 uri = /network-bootstore-config
18622024-06-25T07:14:16.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44920 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51753 req_id = 44f00104-8343-4c39-ad91-d162e229b302 response_code = 204 uri = /switch-ports
18632024-06-25T07:14:16.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 885 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51753 req_id = 349c94e0-b136-4f92-9cf3-8007f08f5307 response_code = 200 uri = /network-bootstore-config
18642024-06-25T07:14:17.484ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 616 local_addr = [fd00:1122:3344:101::1]:34584 method = GET remote_addr = [fd00:1122:3344:101::d]:47281 req_id = a8ec2654-6c7c-4d48-b8d6-cc5154ada3eb response_code = 200 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 uri = /6ec53d70-2eff-4360-abaf-e88d5a5744b1
18652024-06-25T07:14:45.793ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62135
18662024-06-25T07:14:45.793ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 84 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62135 req_id = 9a828928-611c-4325-b898-e2c0784e76c5 response_code = 200 uri = /baseboard
18672024-06-25T07:14:46.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45459
18682024-06-25T07:14:46.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45459 req_id = bb213a99-e1bc-4200-9b4a-ec56ab3d0334 response_code = 200 uri = /v2p
18692024-06-25T07:14:46.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58091
18702024-06-25T07:14:46.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58091 req_id = dac45b50-0334-4fa9-81c0-78652110e4d3 response_code = 200 uri = /v2p
18712024-06-25T07:14:46.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42845
18722024-06-25T07:14:46.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 52099 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42845 req_id = a8a2e2b7-2b7b-46c9-b2d7-8fd9fac1e6a7 response_code = 204 uri = /switch-ports
18732024-06-25T07:14:46.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42575
18742024-06-25T07:14:46.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42575 req_id = 4fb66408-5b90-4a09-b7a3-baf5149fd2e5 response_code = 200 uri = /v2p
18752024-06-25T07:14:46.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42845 req_id = da9f6145-3136-463a-b1f1-b5687dfccd45 response_code = 200 uri = /network-bootstore-config
18762024-06-25T07:14:46.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52264
18772024-06-25T07:14:46.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45996 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52264 req_id = d4e2b478-945f-47ac-911d-d64f447fe5c3 response_code = 204 uri = /switch-ports
18782024-06-25T07:14:46.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61810
18792024-06-25T07:14:46.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3239 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52264 req_id = deaf9e8d-d9ff-4c45-bc91-8a50751c7eab response_code = 200 uri = /network-bootstore-config
18802024-06-25T07:14:46.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 41384 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61810 req_id = 5d86d97e-f138-4acc-8d28-ad5265c63527 response_code = 204 uri = /switch-ports
18812024-06-25T07:14:46.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61810 req_id = af1429e2-dd75-4043-9dea-d6d1c494ae6d response_code = 200 uri = /network-bootstore-config
18822024-06-25T07:14:47.486ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1215 local_addr = [fd00:1122:3344:101::1]:34584 method = GET remote_addr = [fd00:1122:3344:101::d]:47281 req_id = c3982a49-a22c-4d47-97b2-bf583bf65e61 response_code = 200 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 uri = /6ec53d70-2eff-4360-abaf-e88d5a5744b1
18832024-06-25T07:15:15.825ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46986
18842024-06-25T07:15:15.825ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46986 req_id = 1016389f-56aa-4b53-9e50-0257c9e5438a response_code = 200 uri = /baseboard
18852024-06-25T07:15:16.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48704
18862024-06-25T07:15:16.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1048 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48704 req_id = 2f5e0454-13b6-4724-981e-57a3667e6740 response_code = 200 uri = /v2p
18872024-06-25T07:15:16.454ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50202
18882024-06-25T07:15:16.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50202 req_id = 246c8b66-353c-48cf-a67d-2fdbff801a1f response_code = 200 uri = /v2p
18892024-06-25T07:15:16.593ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51821
18902024-06-25T07:15:16.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51821 req_id = e98040d5-61ce-40d9-8859-b95f70b19e09 response_code = 200 uri = /v2p
18912024-06-25T07:15:16.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38432
18922024-06-25T07:15:16.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43317 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38432 req_id = be68656c-302a-4211-8993-03231f11ef7e response_code = 204 uri = /switch-ports
18932024-06-25T07:15:16.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38432 req_id = 58182460-ed76-4594-93a1-9dfa7076fc4a response_code = 200 uri = /network-bootstore-config
18942024-06-25T07:15:16.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51446
18952024-06-25T07:15:16.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43065 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51446 req_id = 3b9d4564-676d-4a13-b17a-4bfd1eb99cd3 response_code = 204 uri = /switch-ports
18962024-06-25T07:15:16.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62318
18972024-06-25T07:15:16.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 40557 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62318 req_id = f5fb1eee-b8e6-4c02-9bae-baa08ce38583 response_code = 204 uri = /switch-ports
18982024-06-25T07:15:16.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51446 req_id = 8e2987e5-eb8c-4af5-b20c-aa22479a1fff response_code = 200 uri = /network-bootstore-config
18992024-06-25T07:15:16.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62318 req_id = 68238a7f-f1b9-4e28-81c8-05b9ac7bd824 response_code = 200 uri = /network-bootstore-config
19002024-06-25T07:15:17.504ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4042 local_addr = [fd00:1122:3344:101::1]:34584 method = GET remote_addr = [fd00:1122:3344:101::d]:47281 req_id = 2de0e9d3-7da7-44b0-9886-c8c9f0dea379 response_code = 200 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 uri = /6ec53d70-2eff-4360-abaf-e88d5a5744b1
19012024-06-25T07:15:19.234ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:300
19022024-06-25T07:15:19.234ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19032024-06-25T07:15:19.272ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 2647, tv_nsec: 707389383 } time_to_next_cleanup = 599.99999605s
19042024-06-25T07:15:32.922ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
19052024-06-25T07:15:45.857ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45851
19062024-06-25T07:15:45.857ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 91 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45851 req_id = 0c65b576-3ae5-473d-9949-163a453fb175 response_code = 200 uri = /baseboard
19072024-06-25T07:15:46.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50516
19082024-06-25T07:15:46.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50516 req_id = f388fa92-2872-4f7a-929a-365ed15dbf1d response_code = 200 uri = /v2p
19092024-06-25T07:15:46.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46750
19102024-06-25T07:15:46.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46750 req_id = d2e7ee90-dafd-41d4-a17c-2d46c317a14e response_code = 200 uri = /v2p
19112024-06-25T07:15:46.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46431
19122024-06-25T07:15:46.674ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 212011bd-1c29-4057-be32-2d2d45256d4a, kind: Service { id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd }, name: Name("external-dns-663f6433-2ca0-4fc1-899e-b6c962f7d0bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 57ff0e16-6252-4c77-9979-6e1fb5d6cc92, kind: Service { id: bcea44c5-0687-4b95-a9f6-4d077176834e }, name: Name("external-dns-bcea44c5-0687-4b95-a9f6-4d077176834e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 74])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05643272-aead-47b3-a9d0-2cd6a6a16e37, kind: Service { id: 8c9d931a-8357-4732-aa0e-9c884346c3d5 }, name: Name("nexus-8c9d931a-8357-4732-aa0e-9c884346c3d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 3acee3d9-6047-479a-9bb5-045ee4d50428, kind: Service { id: d9135b4f-2200-4730-bcb9-64beda649f6d }, name: Name("nexus-d9135b4f-2200-4730-bcb9-64beda649f6d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 15])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 74a27047-fbe2-465f-ad7e-89723ac0b01c, kind: Service { id: 94aef47d-c355-463a-b987-9e3fb672eea0 }, name: Name("nexus-94aef47d-c355-463a-b987-9e3fb672eea0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19132024-06-25T07:15:46.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19142024-06-25T07:15:46.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19152024-06-25T07:15:46.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19162024-06-25T07:15:46.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19172024-06-25T07:15:46.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
19182024-06-25T07:15:46.674ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19192024-06-25T07:15:46.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 443 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46431 req_id = b42a8a6e-783a-49e1-8ed8-a7a3d5a0579a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19202024-06-25T07:15:46.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48712
19212024-06-25T07:15:46.688ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 212011bd-1c29-4057-be32-2d2d45256d4a, kind: Service { id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd }, name: Name("external-dns-663f6433-2ca0-4fc1-899e-b6c962f7d0bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 57ff0e16-6252-4c77-9979-6e1fb5d6cc92, kind: Service { id: bcea44c5-0687-4b95-a9f6-4d077176834e }, name: Name("external-dns-bcea44c5-0687-4b95-a9f6-4d077176834e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 74])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05643272-aead-47b3-a9d0-2cd6a6a16e37, kind: Service { id: 8c9d931a-8357-4732-aa0e-9c884346c3d5 }, name: Name("nexus-8c9d931a-8357-4732-aa0e-9c884346c3d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 3acee3d9-6047-479a-9bb5-045ee4d50428, kind: Service { id: d9135b4f-2200-4730-bcb9-64beda649f6d }, name: Name("nexus-d9135b4f-2200-4730-bcb9-64beda649f6d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 15])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 74a27047-fbe2-465f-ad7e-89723ac0b01c, kind: Service { id: 94aef47d-c355-463a-b987-9e3fb672eea0 }, name: Name("nexus-94aef47d-c355-463a-b987-9e3fb672eea0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19222024-06-25T07:15:46.688ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19232024-06-25T07:15:46.688ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19242024-06-25T07:15:46.688ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19252024-06-25T07:15:46.688ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19262024-06-25T07:15:46.688ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
19272024-06-25T07:15:46.688ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19282024-06-25T07:15:46.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1082 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48712 req_id = 95cd2eae-e4c5-4560-9087-9a17985c8e45 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19292024-06-25T07:15:46.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34012
19302024-06-25T07:15:46.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34012 req_id = d097dde8-e09e-4ce3-946c-73aa71c6df36 response_code = 200 uri = /v2p
19312024-06-25T07:15:46.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51816
19322024-06-25T07:15:46.794ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 212011bd-1c29-4057-be32-2d2d45256d4a, kind: Service { id: 663f6433-2ca0-4fc1-899e-b6c962f7d0bd }, name: Name("external-dns-663f6433-2ca0-4fc1-899e-b6c962f7d0bd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 238, 65])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 57ff0e16-6252-4c77-9979-6e1fb5d6cc92, kind: Service { id: bcea44c5-0687-4b95-a9f6-4d077176834e }, name: Name("external-dns-bcea44c5-0687-4b95-a9f6-4d077176834e"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 74])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 05643272-aead-47b3-a9d0-2cd6a6a16e37, kind: Service { id: 8c9d931a-8357-4732-aa0e-9c884346c3d5 }, name: Name("nexus-8c9d931a-8357-4732-aa0e-9c884346c3d5"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 244])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 3acee3d9-6047-479a-9bb5-045ee4d50428, kind: Service { id: d9135b4f-2200-4730-bcb9-64beda649f6d }, name: Name("nexus-d9135b4f-2200-4730-bcb9-64beda649f6d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 144, 15])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 74a27047-fbe2-465f-ad7e-89723ac0b01c, kind: Service { id: 94aef47d-c355-463a-b987-9e3fb672eea0 }, name: Name("nexus-94aef47d-c355-463a-b987-9e3fb672eea0"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 65])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19332024-06-25T07:15:46.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19342024-06-25T07:15:46.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19352024-06-25T07:15:46.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19362024-06-25T07:15:46.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19372024-06-25T07:15:46.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
19382024-06-25T07:15:46.794ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19392024-06-25T07:15:46.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51816 req_id = 446f3d4c-8951-4714-942d-2b8518b7306d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19402024-06-25T07:15:46.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43494
19412024-06-25T07:15:46.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48567 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43494 req_id = 9cc1358f-9e27-468e-bc33-f5df8c47745e response_code = 204 uri = /switch-ports
19422024-06-25T07:15:46.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62520
19432024-06-25T07:15:47.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43494 req_id = c9e0a376-bad1-4c29-ae94-e763dfa34082 response_code = 200 uri = /network-bootstore-config
19442024-06-25T07:15:47.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46752 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62520 req_id = f8b098d4-a7b4-4644-9fa0-6bb131598e27 response_code = 204 uri = /switch-ports
19452024-06-25T07:15:47.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62520 req_id = a867a98d-6543-4e19-92de-b66707f85514 response_code = 200 uri = /network-bootstore-config
19462024-06-25T07:15:47.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54669
19472024-06-25T07:15:47.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42751 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54669 req_id = a554ca7f-d8a0-4555-9e30-2044865d2d9a response_code = 204 uri = /switch-ports
19482024-06-25T07:15:47.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 797 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54669 req_id = f0616f91-d646-4cae-b032-3f105cbe9c94 response_code = 200 uri = /network-bootstore-config
19492024-06-25T07:15:47.553ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 823 local_addr = [fd00:1122:3344:101::1]:34584 method = GET remote_addr = [fd00:1122:3344:101::d]:47281 req_id = 39d20cf8-cd55-473f-b5e9-c3bd458b4671 response_code = 200 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 uri = /6ec53d70-2eff-4360-abaf-e88d5a5744b1
19502024-06-25T07:16:15.891ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59722
19512024-06-25T07:16:15.891ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 71 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59722 req_id = 103fd056-47a8-46b4-87c8-7afb0a75f59d response_code = 200 uri = /baseboard
19522024-06-25T07:16:16.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59338
19532024-06-25T07:16:16.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59338 req_id = 1df166b5-9fab-470b-8440-63eb923ff47b response_code = 200 uri = /v2p
19542024-06-25T07:16:16.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62669
19552024-06-25T07:16:16.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62669 req_id = 6c889574-4c45-4bbe-9930-6c90d71e0ac1 response_code = 200 uri = /v2p
19562024-06-25T07:16:16.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35667
19572024-06-25T07:16:16.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 853 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35667 req_id = 797994de-5c5e-40e5-9c2a-b73006466517 response_code = 200 uri = /v2p
19582024-06-25T07:16:16.553ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48625
19592024-06-25T07:16:16.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48625 req_id = 6e5d3102-caeb-4eab-b06f-2dbbfc748cad response_code = 204 uri = /switch-ports
19602024-06-25T07:16:16.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48625 req_id = 6e434862-d540-494b-9820-b72a4bc92abe response_code = 200 uri = /network-bootstore-config
19612024-06-25T07:16:16.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56648
19622024-06-25T07:16:16.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43976 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56648 req_id = eb5ac145-3547-434d-b1c2-92cd23055950 response_code = 204 uri = /switch-ports
19632024-06-25T07:16:16.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56648 req_id = c73cd1eb-f18c-4250-be0a-9b968154c71b response_code = 200 uri = /network-bootstore-config
19642024-06-25T07:16:16.716ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61344
19652024-06-25T07:16:16.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45460 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61344 req_id = f07f4027-5643-4c65-8bbd-e0fa7819edd5 response_code = 204 uri = /switch-ports
19662024-06-25T07:16:16.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61344 req_id = f1b364ed-444c-44bb-8382-93aac6048515 response_code = 200 uri = /network-bootstore-config
19672024-06-25T07:16:17.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 706 local_addr = [fd00:1122:3344:101::1]:34584 method = GET remote_addr = [fd00:1122:3344:101::d]:47281 req_id = b51e2344-b3d9-4afc-8bbf-155a62fe66c0 response_code = 200 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 uri = /6ec53d70-2eff-4360-abaf-e88d5a5744b1
19682024-06-25T07:16:45.925ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63649
19692024-06-25T07:16:45.925ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 90 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63649 req_id = f3e65bd1-c0c2-487e-9b8a-9675f3b0458c response_code = 200 uri = /baseboard
19702024-06-25T07:16:46.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59155
19712024-06-25T07:16:46.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1031 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59155 req_id = 5f34c037-98bc-40ed-88e9-5ec4ac83c21c response_code = 200 uri = /v2p
19722024-06-25T07:16:46.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58012
19732024-06-25T07:16:46.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58012 req_id = 765d408b-dff3-44f2-aa40-374d831ff2c3 response_code = 200 uri = /v2p
19742024-06-25T07:16:46.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59575
19752024-06-25T07:16:46.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59575 req_id = c945679b-3f42-4737-ae56-dcd20a5d7177 response_code = 200 uri = /v2p
19762024-06-25T07:16:46.654ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42918
19772024-06-25T07:16:46.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48940 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42918 req_id = d536dc18-8510-40e3-b6f4-e8f102131bf0 response_code = 204 uri = /switch-ports
19782024-06-25T07:16:46.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49065
19792024-06-25T07:16:46.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42918 req_id = 16221691-b39e-4477-9dd9-b8309794cba6 response_code = 200 uri = /network-bootstore-config
19802024-06-25T07:16:46.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50558 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49065 req_id = e6d7cada-9933-4461-9f05-c5178d027500 response_code = 204 uri = /switch-ports
19812024-06-25T07:16:46.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49065 req_id = 593eae1b-b257-452d-8251-0967640e8625 response_code = 200 uri = /network-bootstore-config
19822024-06-25T07:16:46.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33094
19832024-06-25T07:16:46.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 40604 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33094 req_id = dcb9522d-3fd4-45b6-8cc7-031e3aace7b8 response_code = 204 uri = /switch-ports
19842024-06-25T07:16:46.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 923 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33094 req_id = 53d70d01-7d3f-4524-9433-08a244fa293d response_code = 200 uri = /network-bootstore-config
19852024-06-25T07:16:47.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 685 local_addr = [fd00:1122:3344:101::1]:34584 method = GET remote_addr = [fd00:1122:3344:101::d]:47281 req_id = c1e25afb-d90d-4a1a-ab7f-c7b750653ef0 response_code = 200 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 uri = /6ec53d70-2eff-4360-abaf-e88d5a5744b1
19862024-06-25T07:17:06.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44907
19872024-06-25T07:17:06.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44907 req_id = e7f967d5-f9d2-4e9c-90b8-9693591f2d48 response_code = 200 uri = /v2p
19882024-06-25T07:17:06.042ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(8867063) }
19892024-06-25T07:17:06.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44907 req_id = 1a4fdc80-56e1-4a7b-8aa8-9de8911709a3 response_code = 204 uri = /v2p
19902024-06-25T07:17:06.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41812
19912024-06-25T07:17:06.192ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:548 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 928c25e9-424a-4c68-b032-36492cd56ed1, kind: Instance { id: 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8867063), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 928c25e9-424a-4c68-b032-36492cd56ed1, kind: Instance { id: 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8867063), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 928c25e9-424a-4c68-b032-36492cd56ed1, kind: Instance { id: 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8867063), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(8867063))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 928c25e9-424a-4c68-b032-36492cd56ed1, kind: Instance { id: 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8867063), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-754178bb24c", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ca596aea-e381-458d-b1e1-9546c68b3f39, read_only_parent: Some(Volume { block_size: 512, id: 6cb7500e-a03c-488f-93d9-8f73aa50561b, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b119e5eb-287d-436f-8861-32bb42c34fa4, key: Some("8viXbs96V4GGD175dfG0k9QvL+nr9Oy6BNX/blPLvf8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ca596aea-e381-458d-b1e1-9546c68b3f39, key: Some("1D6FMJLYWc5Xk7d3Z/NYH1A3TDcGPoDfHM6KS7dy6jc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAOIzrZWNlYAAAjOtlYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAADyM62VjZWAAAIzrZWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIxMGZjNzlhMi01YWI5LTQzNWEtOWUyMS03MGUwZmIxZWIzNTgiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQUNnckVVOWFZY0sxZVk3NXBobHp6Wk5BdWRaVzRFMTBzaU1keDBjbVhUQyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 instance_runtime = InstanceRuntimeState { propolis_id: Some(e728cc6b-9633-44a0-834d-c3050b799e01 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T07:17:05.841065461Z } metadata = InstanceMetadata { silo_id: f4a0100a-1349-4204-881f-25fd994d3ce4, project_id: 6f59f268-16a7-41da-8b7e-bc7ff40731d5 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = e728cc6b-9633-44a0-834d-c3050b799e01 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-25T07:17:05.815434Z }
19922024-06-25T07:17:06.192ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:582 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 (instance)
19932024-06-25T07:17:06.193ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:942 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 propolis_id = e728cc6b-9633-44a0-834d-c3050b799e01 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 928c25e9-424a-4c68-b032-36492cd56ed1, kind: Instance { id: 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8867063), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 928c25e9-424a-4c68-b032-36492cd56ed1, kind: Instance { id: 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8867063), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 928c25e9-424a-4c68-b032-36492cd56ed1, kind: Instance { id: 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8867063), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(8867063))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 928c25e9-424a-4c68-b032-36492cd56ed1, kind: Instance { id: 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(8867063), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-754178bb24c", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ca596aea-e381-458d-b1e1-9546c68b3f39, read_only_parent: Some(Volume { block_size: 512, id: 6cb7500e-a03c-488f-93d9-8f73aa50561b, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b119e5eb-287d-436f-8861-32bb42c34fa4, key: Some("8viXbs96V4GGD175dfG0k9QvL+nr9Oy6BNX/blPLvf8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ca596aea-e381-458d-b1e1-9546c68b3f39, key: Some("1D6FMJLYWc5Xk7d3Z/NYH1A3TDcGPoDfHM6KS7dy6jc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAOIzrZWNlYAAAjOtlYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAADyM62VjZWAAAIzrZWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIxMGZjNzlhMi01YWI5LTQzNWEtOWUyMS03MGUwZmIxZWIzNTgiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQUNnckVVOWFZY0sxZVk3NXBobHp6Wk5BdWRaVzRFMTBzaU1keDBjbVhUQyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(e728cc6b-9633-44a0-834d-c3050b799e01 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T07:17:05.841065461Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-25T07:17:05.815434Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
19942024-06-25T07:17:06.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 10581 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41812 req_id = 7eb26fa4-c2eb-4b91-b4d1-ef12ab9f1d45 response_code = 200 uri = /instances/10fc79a2-5ab9-435a-9e21-70e0fb1eb358
19952024-06-25T07:17:06.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53132
19962024-06-25T07:17:06.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1754 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53132 req_id = 6016884f-c8d6-42ab-bdec-caf2de632c8d response_code = 200 uri = /instances/10fc79a2-5ab9-435a-9e21-70e0fb1eb358/state
19972024-06-25T07:17:06.334ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 241, 37, 196]), slot: 0, vni: Vni { inner: 8867063 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
19982024-06-25T07:17:06.334ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19992024-06-25T07:17:06.367ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01 file = illumos-utils/src/zone.rs:315 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20002024-06-25T07:17:06.390ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01 file = illumos-utils/src/zone.rs:354 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20012024-06-25T07:17:07.775ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::b]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20022024-06-25T07:17:07.775ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20032024-06-25T07:17:07.954ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01") failed: Property not found. retry in 73.164448ms file = illumos-utils/src/svc.rs:36 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20042024-06-25T07:17:08.066ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01") failed: Property not found. retry in 77.207664ms file = illumos-utils/src/svc.rs:36 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20052024-06-25T07:17:08.158ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01") failed: Property not found. retry in 152.282809ms file = illumos-utils/src/svc.rs:36 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20062024-06-25T07:17:08.326ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01") failed: Property not found. retry in 406.298274ms file = illumos-utils/src/svc.rs:36 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20072024-06-25T07:17:08.743ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01") failed: Property not found. retry in 825.982714ms file = illumos-utils/src/svc.rs:36 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20082024-06-25T07:17:09.580ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01") failed: Property not found. retry in 876.91201ms file = illumos-utils/src/svc.rs:36 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20092024-06-25T07:17:10.466ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01") failed: Property not found. retry in 755.030681ms file = illumos-utils/src/svc.rs:36 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20102024-06-25T07:17:11.232ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01") failed: Property not found. retry in 1.304552173s file = illumos-utils/src/svc.rs:36 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20112024-06-25T07:17:12.547ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01") failed: Property not found. retry in 932.071426ms file = illumos-utils/src/svc.rs:36 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 zone = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20122024-06-25T07:17:13.506ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01 file = sled-agent/src/instance.rs:1427 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20132024-06-25T07:17:13.514ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1436 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20142024-06-25T07:17:13.553ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1450 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20152024-06-25T07:17:13.554ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAOIzrZWNlYAAAjOtlYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAADyM62VjZWAAAIzrZWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIxMGZjNzlhMi01YWI5LTQzNWEtOWUyMS03MGUwZmIxZWIzNTgiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJQUNnckVVOWFZY0sxZVk3NXBobHp6Wk5BdWRaVzRFMTBzaU1keDBjbVhUQyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-754178bb24c", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: ca596aea-e381-458d-b1e1-9546c68b3f39, read_only_parent: Some(Volume { block_size: 512, id: 6cb7500e-a03c-488f-93d9-8f73aa50561b, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: b119e5eb-287d-436f-8861-32bb42c34fa4, key: Some("8viXbs96V4GGD175dfG0k9QvL+nr9Oy6BNX/blPLvf8="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19001", "[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: ca596aea-e381-458d-b1e1-9546c68b3f39, key: Some("1D6FMJLYWc5Xk7d3Z/NYH1A3TDcGPoDfHM6KS7dy6jc="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::13]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: 10fc79a2-5ab9-435a-9e21-70e0fb1eb358, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 6f59f268-16a7-41da-8b7e-bc7ff40731d5, silo_id: f4a0100a-1349-4204-881f-25fd994d3ce4 }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:689 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20162024-06-25T07:17:13.736ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:691 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20172024-06-25T07:17:13.738ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-06-25T07:17:13.737791285Z } file = sled-agent/src/instance.rs:573 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20182024-06-25T07:17:13.738ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 new_instance_state = InstanceRuntimeState { propolis_id: Some(e728cc6b-9633-44a0-834d-c3050b799e01 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T07:17:05.841065461Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-25T07:17:13.737791285Z } propolis_id = e728cc6b-9633-44a0-834d-c3050b799e01
20192024-06-25T07:17:13.738ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(e728cc6b-9633-44a0-834d-c3050b799e01 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T07:17:05.841065461Z }, propolis_id: e728cc6b-9633-44a0-834d-c3050b799e01 (propolis), vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-25T07:17:13.737791285Z }, migration_state: None }
20202024-06-25T07:17:13.802ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-06-25T07:17:13.802973923Z } file = sled-agent/src/instance.rs:573 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20212024-06-25T07:17:13.803ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 new_instance_state = InstanceRuntimeState { propolis_id: Some(e728cc6b-9633-44a0-834d-c3050b799e01 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T07:17:05.841065461Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-25T07:17:13.802973923Z } propolis_id = e728cc6b-9633-44a0-834d-c3050b799e01
20222024-06-25T07:17:13.803ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(e728cc6b-9633-44a0-834d-c3050b799e01 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T07:17:05.841065461Z }, propolis_id: e728cc6b-9633-44a0-834d-c3050b799e01 (propolis), vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-25T07:17:13.802973923Z }, migration_state: None }
20232024-06-25T07:17:15.957ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37783
20242024-06-25T07:17:15.957ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 107 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37783 req_id = d3744edf-1b0f-4b77-b4aa-17e0677ae5bb response_code = 200 uri = /baseboard
20252024-06-25T07:17:16.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44540
20262024-06-25T07:17:16.430ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44540 req_id = f927a95f-9905-437a-89ab-b8a8fcda186c response_code = 200 uri = /v2p
20272024-06-25T07:17:16.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36640
20282024-06-25T07:17:16.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36640 req_id = ef36e657-7064-4fdd-a8a0-3ddd4bba57e7 response_code = 200 uri = /instances/10fc79a2-5ab9-435a-9e21-70e0fb1eb358/state
20292024-06-25T07:17:16.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58545
20302024-06-25T07:17:16.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1580 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58545 req_id = e8cb884a-0a32-4e9f-aa67-35d757133890 response_code = 200 uri = /instances/10fc79a2-5ab9-435a-9e21-70e0fb1eb358/state
20312024-06-25T07:17:16.549ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47679
20322024-06-25T07:17:16.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47679 req_id = 10d72bff-b4ac-4be2-a3ba-a6da35f8e4fc response_code = 200 uri = /instances/10fc79a2-5ab9-435a-9e21-70e0fb1eb358/state
20332024-06-25T07:17:16.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52070
20342024-06-25T07:17:16.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52070 req_id = 660d2dfb-7dcb-4e77-98a5-c1d23a10175e response_code = 200 uri = /v2p
20352024-06-25T07:17:16.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50071
20362024-06-25T07:17:16.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50071 req_id = a91f319d-1223-42ef-96e2-92ca5b74b5c4 response_code = 200 uri = /v2p
20372024-06-25T07:17:16.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38257
20382024-06-25T07:17:16.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47748 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38257 req_id = d6cfe036-9a50-4d7a-bed9-435816c4fdec response_code = 204 uri = /switch-ports
20392024-06-25T07:17:16.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41216
20402024-06-25T07:17:16.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3755 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38257 req_id = 7058012a-b4a3-47ac-a619-009f0cfdaf94 response_code = 200 uri = /network-bootstore-config
20412024-06-25T07:17:16.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49014 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41216 req_id = 716ed63c-d381-4179-8101-554529dd055d response_code = 204 uri = /switch-ports
20422024-06-25T07:17:16.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 930 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41216 req_id = dd39943c-32b8-4864-90d8-633a8ab13dd7 response_code = 200 uri = /network-bootstore-config
20432024-06-25T07:17:16.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46437
20442024-06-25T07:17:16.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48307 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46437 req_id = 3430dc0f-a5bb-47ff-90c2-82af241a5436 response_code = 204 uri = /switch-ports
20452024-06-25T07:17:16.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46437 req_id = b66b9b37-93c3-48bb-926b-6d42357fa0d2 response_code = 200 uri = /network-bootstore-config
20462024-06-25T07:17:17.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 638 local_addr = [fd00:1122:3344:101::1]:34584 method = GET remote_addr = [fd00:1122:3344:101::d]:47281 req_id = c7777d97-a75c-47a6-b9ab-3f75d9117239 response_code = 200 sled_id = 6ec53d70-2eff-4360-abaf-e88d5a5744b1 uri = /6ec53d70-2eff-4360-abaf-e88d5a5744b1
20472024-06-25T07:17:23.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53852
20482024-06-25T07:17:23.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 581 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53852 req_id = 839cbcac-44ac-4832-ada2-ebb33ff3c3ce response_code = 200 uri = /instances/10fc79a2-5ab9-435a-9e21-70e0fb1eb358/state
20492024-06-25T07:17:23.001ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-06-25T07:17:23.001121887Z } file = sled-agent/src/instance.rs:573 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20502024-06-25T07:17:23.001ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 new_instance_state = InstanceRuntimeState { propolis_id: Some(e728cc6b-9633-44a0-834d-c3050b799e01 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T07:17:05.841065461Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-25T07:17:23.001121887Z } propolis_id = e728cc6b-9633-44a0-834d-c3050b799e01
20512024-06-25T07:17:23.001ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(e728cc6b-9633-44a0-834d-c3050b799e01 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-25T07:17:05.841065461Z }, propolis_id: e728cc6b-9633-44a0-834d-c3050b799e01 (propolis), vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-25T07:17:23.001121887Z }, migration_state: None }
20522024-06-25T07:17:23.051ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-06-25T07:17:23.051507540Z } file = sled-agent/src/instance.rs:573 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20532024-06-25T07:17:23.051ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-25T07:17:23.051507540Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-06-25T07:17:23.051507540Z } propolis_id = e728cc6b-9633-44a0-834d-c3050b799e01
20542024-06-25T07:17:23.051ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:610 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20552024-06-25T07:17:23.051ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
20562024-06-25T07:17:23.051ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
20572024-06-25T07:17:23.051ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/97ed7846-dc54-4083-af8f-8638d77ed528/debug/bundle/zone", "/pool/int/e538e077-d59a-4cd5-a9f6-4ddd0689c38f/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/91a012db-ba8e-458f-bad0-85c50bdcfbd2/crypt/debug", "/pool/ext/bd1f77a7-498c-47a0-8675-d771ae1ccef9/crypt/debug", "/pool/ext/9d857f30-656d-45b2-a37a-c31b060c8fae/crypt/debug", "/pool/ext/73cdba2f-4771-4438-b5c3-84e7216dff0f/crypt/debug", "/pool/ext/48b3c1a3-2c17-4973-8e17-8af9bebce768/crypt/debug", "/pool/ext/eba9a72e-79ea-4722-8854-b5f41ec1c20b/crypt/debug", "/pool/ext/44c5b0cd-d3ea-4e74-85a6-2b3104ab94bf/crypt/debug", "/pool/ext/6c00033c-63f1-47a0-8b42-6f61b082d646/crypt/debug", "/pool/ext/6897e83c-187d-4573-a81f-bb7d6f202eb3/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01
20582024-06-25T07:17:23.665ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01", bundle_id: e49da403-2f43-49af-9046-b49c926fe3b2 }, time_created: 2024-06-25T07:17:23.053435718Z, version: 0, cause: TerminatedInstance }
20592024-06-25T07:17:23.665ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_e728cc6b-9633-44a0-834d-c3050b799e01 file = sled-agent/src/instance.rs:784 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20602024-06-25T07:17:25.413ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20612024-06-25T07:17:25.438ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-25T07:17:23.051507540Z }, propolis_id: e728cc6b-9633-44a0-834d-c3050b799e01 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-25T07:17:25.438844286Z }, migration_state: None }
20622024-06-25T07:17:25.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52495
20632024-06-25T07:17:25.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 789 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52495 req_id = 3a13666d-8df1-41e7-a567-06de14737b0b response_code = 200 uri = /v2p
20642024-06-25T07:17:25.529ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(8867063) }
20652024-06-25T07:17:25.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52495 req_id = 478438d1-7252-4af8-ab73-8e0e2f022b94 response_code = 204 uri = /v2p
20662024-06-25T07:17:25.716ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-25T07:17:23.051507540Z }, propolis_id: e728cc6b-9633-44a0-834d-c3050b799e01 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-25T07:17:25.438844286Z }, migration_state: None }
20672024-06-25T07:17:25.720ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:727 instance_id = 10fc79a2-5ab9-435a-9e21-70e0fb1eb358
20682024-06-25T07:17:25.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41291
20692024-06-25T07:17:25.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 871 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41291 req_id = 8aece5c2-fa11-40a7-978a-bfdb3a6b55d7 response_code = 200 uri = /v2p
20702024-06-25T07:17:25.871ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:671 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 241, 37, 196])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(8867063) }
20712024-06-25T07:17:25.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:41291 req_id = 21fbdde4-1de1-49cb-8a3f-d744415f3982 response_code = 204 uri = /v2p