Max level shown:
1 [ May 23 04:06:42 Enabled. ]
2 [ May 23 04:06:42 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ May 23 04:06:42 Method "start" exited with status 0. ]
4 [ May 23 04:06:42 Rereading configuration. ]
5 [ May 23 04:06:42 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-05-23T04:06:42.775ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-05-23T04:06:42.775ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-05-23T04:06:42.828ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-05-23T04:06:42.828ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-05-23T04:06:42.944ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-05-23T04:06:42.953ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-05-23T04:06:42.961ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-05-23T04:06:43.567ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:a02a::, len: 64 }
152024-05-23T04:06:43.704ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-05-23T04:06:43.705ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-05-23T04:06:43.705ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-05-23T04:06:43.705ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-05-23T04:06:43.705ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:506
202024-05-23T04:06:43.705ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:625
212024-05-23T04:06:43.708ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
222024-05-23T04:06:43.708ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:674
232024-05-23T04:06:43.708ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242024-05-23T04:06:43.708ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:733
252024-05-23T04:06:43.708ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
262024-05-23T04:06:43.708ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = None
272024-05-23T04:06:43.708ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
282024-05-23T04:06:43.708ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-05-23T04:06:43.708ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-05-23T04:06:43.719ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:304
312024-05-23T04:06:43.719ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool)
322024-05-23T04:06:43.816ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal }
332024-05-23T04:06:44.018ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
342024-05-23T04:06:44.018ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
352024-05-23T04:06:44.018ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-05-23T04:06:44.018ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-05-23T04:06:44.018ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
382024-05-23T04:06:44.018ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-05-23T04:06:44.018ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-05-23T04:06:44.027ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:304
412024-05-23T04:06:44.027ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = dc107f05-7499-4442-b1eb-bd9424553a87 (zpool)
422024-05-23T04:06:44.112ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal }
432024-05-23T04:06:44.313ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
442024-05-23T04:06:44.313ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
452024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
462024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
472024-05-23T04:06:44.313ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
482024-05-23T04:06:44.313ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-05-23T04:06:44.313ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
502024-05-23T04:06:44.313ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
512024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
522024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
532024-05-23T04:06:44.313ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-05-23T04:06:44.313ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-05-23T04:06:44.313ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
562024-05-23T04:06:44.313ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
572024-05-23T04:06:44.313ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
582024-05-23T04:06:44.313ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
602024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
612024-05-23T04:06:44.313ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
622024-05-23T04:06:44.313ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
632024-05-23T04:06:44.313ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
642024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
652024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
662024-05-23T04:06:44.313ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-05-23T04:06:44.313ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
682024-05-23T04:06:44.313ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
692024-05-23T04:06:44.313ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
702024-05-23T04:06:44.313ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
722024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
732024-05-23T04:06:44.313ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
742024-05-23T04:06:44.313ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
752024-05-23T04:06:44.313ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
762024-05-23T04:06:44.313ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
772024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
782024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
792024-05-23T04:06:44.313ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
802024-05-23T04:06:44.313ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
812024-05-23T04:06:44.313ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
822024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
832024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
842024-05-23T04:06:44.313ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-05-23T04:06:44.313ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
862024-05-23T04:06:44.313ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
872024-05-23T04:06:44.313ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
882024-05-23T04:06:44.313ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
892024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
902024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
912024-05-23T04:06:44.313ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
922024-05-23T04:06:44.313ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
932024-05-23T04:06:44.313ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
942024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
952024-05-23T04:06:44.313ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
962024-05-23T04:06:44.313ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972024-05-23T04:06:44.314ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
982024-05-23T04:06:44.314ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:93
992024-05-23T04:06:44.314ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
1002024-05-23T04:06:44.314ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1012024-05-23T04:06:44.314ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1022024-05-23T04:06:44.314ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1032024-05-23T04:06:44.314ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
1042024-05-23T04:06:44.314ZINFOSledAgent (bootstore): No ledger in /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-05-23T04:06:44.314ZINFOSledAgent (bootstore): No ledger in /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-05-23T04:06:44.314ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-05-23T04:06:44.314ZINFOSledAgent (bootstore): No ledger in /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-05-23T04:06:44.314ZINFOSledAgent (bootstore): No ledger in /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-05-23T04:06:44.314ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-05-23T04:06:44.314ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
1112024-05-23T04:06:44.314ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
1122024-05-23T04:06:44.324ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:711
1132024-05-23T04:06:44.324ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1471, tv_nsec: 723726961 } time_to_next_cleanup = 599.999914279s
1142024-05-23T04:06:44.324ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3617
1152024-05-23T04:06:44.324ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1162024-05-23T04:06:44.327ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-05-23T04:06:44.327ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-05-23T04:06:44.328ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:196 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-05-23T04:06:44.328ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-05-23T04:06:44.328ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 24, }, ), ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1003
1212024-05-23T04:06:44.328ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-05-23T04:06:44.328ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1232024-05-23T04:06:44.328ZINFOSledAgent (RSS): No ledger in /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-05-23T04:06:44.328ZINFOSledAgent (RSS): No ledger in /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-05-23T04:06:44.328ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1063
1262024-05-23T04:06:44.328ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1272024-05-23T04:06:44.328ZINFOSledAgent (RSS): No ledger in /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-05-23T04:06:44.328ZINFOSledAgent (RSS): No ledger in /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-05-23T04:06:44.328ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1104
1302024-05-23T04:06:44.328ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:118
1312024-05-23T04:06:44.328ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:91
1322024-05-23T04:06:44.328ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1332024-05-23T04:06:44.328ZINFOSledAgent (RSS): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-05-23T04:06:44.328ZINFOSledAgent (RSS): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-05-23T04:06:44.329ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:138
1362024-05-23T04:06:44.329ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1137
1372024-05-23T04:06:44.329ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-05-23T04:06:44.329ZINFOSledAgent (bootstore): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-05-23T04:06:44.329ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-05-23T04:06:44.329ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-05-23T04:06:44.329ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: dc42437e-f158-48dc-b8b5-096274c6457c, rack_id: 0abe5f02-86be-4633-bc9c-dd5a3f81bd6d, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-05-23T04:06:44.329ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:48172
1432024-05-23T04:06:44.329ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: dc42437e-f158-48dc-b8b5-096274c6457c, rack_id: 0abe5f02-86be-4633-bc9c-dd5a3f81bd6d, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net(Ipv6Network { addr: fd00:1122:3344:101::, prefix: 64 }) } } } file = sled-agent/src/bootstrap/server.rs:360
1442024-05-23T04:06:44.329ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1452024-05-23T04:06:44.329ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1462024-05-23T04:06:44.329ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1472024-05-23T04:06:44.329ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1482024-05-23T04:06:44.329ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1492024-05-23T04:06:44.329ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1502024-05-23T04:06:44.329ZINFOSledAgent (StorageManager): No ledger in /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1512024-05-23T04:06:44.329ZINFOSledAgent (StorageManager): No ledger in /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-05-23T04:06:44.329ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1532024-05-23T04:06:44.329ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1542024-05-23T04:06:44.332ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3849
1552024-05-23T04:06:44.339ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
1562024-05-23T04:06:44.349ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
1572024-05-23T04:06:44.359ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
1582024-05-23T04:06:44.368ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
1592024-05-23T04:06:44.377ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
1602024-05-23T04:06:44.386ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
1612024-05-23T04:06:44.394ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:353 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
1622024-05-23T04:06:44.394ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1632024-05-23T04:06:44.394ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 106.198239ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "38d82ab6-8dc5-45ef-bcad-34236e9e6611", "content-length": "124", "date": "Thu, 23 May 2024 04:06:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "38d82ab6-8dc5-45ef-bcad-34236e9e6611" } file = clients/ddm-admin-client/src/lib.rs:178
1642024-05-23T04:06:44.394ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
1652024-05-23T04:06:44.403ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
1662024-05-23T04:06:44.411ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
1672024-05-23T04:06:44.411ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1682024-05-23T04:06:44.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1692024-05-23T04:06:44.411ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1702024-05-23T04:06:44.411ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1712024-05-23T04:06:44.411ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1722024-05-23T04:06:44.411ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1732024-05-23T04:06:44.411ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:365 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
1742024-05-23T04:06:44.427ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_00f23dd2-ec1c-47ae-955f-67169b6e6535/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1752024-05-23T04:06:44.433ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1762024-05-23T04:06:44.449ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1772024-05-23T04:06:44.449ZINFOSledAgent: successfully created encrypted zvol: name="oxi_00f23dd2-ec1c-47ae-955f-67169b6e6535/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-05-23T04:06:44.449ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_00f23dd2-ec1c-47ae-955f-67169b6e6535/swap" file = sled-agent/src/swap_device.rs:96
1792024-05-23T04:06:44.456ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:380 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
1802024-05-23T04:06:44.456ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1812024-05-23T04:06:44.456ZINFOSledAgent (BackingFs): Ensuring dataset oxi_00f23dd2-ec1c-47ae-955f-67169b6e6535/backing/fmd file = sled-agent/src/backing_fs.rs:136
1822024-05-23T04:06:44.501ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1832024-05-23T04:06:44.501ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 123.319256ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "15b6fa19-d8be-4090-975e-a974f1560193", "content-length": "124", "date": "Thu, 23 May 2024 04:06:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "15b6fa19-d8be-4090-975e-a974f1560193" } file = clients/ddm-admin-client/src/lib.rs:178
1842024-05-23T04:06:44.526ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1852024-05-23T04:06:44.625ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1862024-05-23T04:06:44.626ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 104.562711ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0375b0dd-8faa-4c50-b2fc-bc3bac51f8eb", "content-length": "124", "date": "Thu, 23 May 2024 04:06:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0375b0dd-8faa-4c50-b2fc-bc3bac51f8eb" } file = clients/ddm-admin-client/src/lib.rs:178
1872024-05-23T04:06:44.731ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1882024-05-23T04:06:44.732ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 190.774586ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3209e78c-9492-4a51-9e32-fb5117e13053", "content-length": "124", "date": "Thu, 23 May 2024 04:06:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3209e78c-9492-4a51-9e32-fb5117e13053" } file = clients/ddm-admin-client/src/lib.rs:178
1892024-05-23T04:06:44.745ZINFOSledAgent (BackingFs): Mounting oxi_00f23dd2-ec1c-47ae-955f-67169b6e6535/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1902024-05-23T04:06:44.758ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1912024-05-23T04:06:44.758ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1922024-05-23T04:06:44.758ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1932024-05-23T04:06:44.758ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1942024-05-23T04:06:44.924ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1952024-05-23T04:06:44.924ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 235.623816ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c3f84947-88c8-4de5-9a45-7af68a4db83f", "content-length": "124", "date": "Thu, 23 May 2024 04:06:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c3f84947-88c8-4de5-9a45-7af68a4db83f" } file = clients/ddm-admin-client/src/lib.rs:178
1962024-05-23T04:06:45.161ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1972024-05-23T04:06:45.162ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 151.5576ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b7f7415e-ba75-44b6-b607-4fa31e322d7b", "content-length": "124", "date": "Thu, 23 May 2024 04:06:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b7f7415e-ba75-44b6-b607-4fa31e322d7b" } file = clients/ddm-admin-client/src/lib.rs:178
1982024-05-23T04:06:45.314ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1992024-05-23T04:06:45.315ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 334.829809ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1c008cf0-f0b3-4b33-9e48-21c48e09d8c4", "content-length": "124", "date": "Thu, 23 May 2024 04:06:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1c008cf0-f0b3-4b33-9e48-21c48e09d8c4" } file = clients/ddm-admin-client/src/lib.rs:178
2002024-05-23T04:06:45.456ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2012024-05-23T04:06:45.457ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:60118 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2022024-05-23T04:06:45.457ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2032024-05-23T04:06:45.457ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:60118 file = oximeter/producer/src/lib.rs:276 interval = 30s producer_id = dc42437e-f158-48dc-b8b5-096274c6457c sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2042024-05-23T04:06:45.464ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 207.112667ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2052024-05-23T04:06:45.511ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2062024-05-23T04:06:45.511ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2072024-05-23T04:06:45.512ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:993 underlay_address = fd00:1122:3344:101::1
2082024-05-23T04:06:45.512ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2092024-05-23T04:06:45.512ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:12345
2102024-05-23T04:06:45.512ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
2112024-05-23T04:06:45.512ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2122024-05-23T04:06:45.512ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2132024-05-23T04:06:45.513ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2142024-05-23T04:06:45.513ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2152024-05-23T04:06:45.513ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV1 { rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV1 { routes: [RouteConfig { destination: V4(Ipv4Network { addr: 0.0.0.0, prefix: 0 }), nexthop: 10.151.2.100, vlan_id: None }], addresses: [V4(Ipv4Network { addr: 10.151.2.174, prefix: 24 })], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2162024-05-23T04:06:45.513ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3617
2172024-05-23T04:06:45.513ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:48172
2182024-05-23T04:06:45.513ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2192024-05-23T04:06:45.513ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2202024-05-23T04:06:45.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2212024-05-23T04:06:45.700ZINFOSledAgent (RSS): No ledger in /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2222024-05-23T04:06:45.700ZINFOSledAgent (RSS): No ledger in /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2232024-05-23T04:06:45.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2242024-05-23T04:06:45.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2252024-05-23T04:06:45.700ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
2262024-05-23T04:06:45.701ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 524.433113ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2272024-05-23T04:06:45.705ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2282024-05-23T04:06:45.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42592
2292024-05-23T04:06:45.732ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2302024-05-23T04:06:45.732ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42592 req_id = 541e858a-f63e-4c72-b562-f1484517f87f response_code = 200 uri = /inventory
2312024-05-23T04:06:45.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47196
2322024-05-23T04:06:45.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47196 req_id = 02431a30-4545-455f-94c9-f8b72e5d5ca1 response_code = 200 uri = /sled-role
2332024-05-23T04:06:45.764ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2342024-05-23T04:06:45.764ZINFOSledAgent (RSS): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2352024-05-23T04:06:45.764ZINFOSledAgent (RSS): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2362024-05-23T04:06:45.764ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:815
2372024-05-23T04:06:45.796ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: 18c0f0a5-ae4c-4ee8-ac12-cb61617da3df, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, pool_id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool) }, OmicronPhysicalDiskConfig { id: 415fbcd4-835e-48f9-80c0-fa4771397f90, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, pool_id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool) }, OmicronPhysicalDiskConfig { id: e689105e-c1fd-49f6-9d05-cf9c9ff4b257, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, pool_id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool) }, OmicronPhysicalDiskConfig { id: 09bd0940-842b-4337-8ff9-3433ced817d7, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, pool_id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool) }, OmicronPhysicalDiskConfig { id: 26ac119a-ed0e-4c78-9b01-fbabb113ff81, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, pool_id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool) }, OmicronPhysicalDiskConfig { id: 21ae1e49-dc39-4a9e-b141-ce6c1656094b, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, pool_id: 127f2afe-c507-4a93-ad56-3834e79f35c8 (zpool) }, OmicronPhysicalDiskConfig { id: 047bf39a-9e55-4a5f-9424-2705cc91df70, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, pool_id: 31801aa5-cbc2-46ad-8317-204ec0a5cef6 (zpool) }, OmicronPhysicalDiskConfig { id: 2048b145-d9d9-460e-8a7f-4f96c8424ea7, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, pool_id: 5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d (zpool) }, OmicronPhysicalDiskConfig { id: 2982f117-0191-4a47-a7e5-39725806f2f4, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, pool_id: b755abc1-d573-403a-80b5-740c5b5b87fd (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:347 sled_address = [fd00:1122:3344:101::1]:12345
2382024-05-23T04:06:45.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61030
2392024-05-23T04:06:45.796ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 18c0f0a5-ae4c-4ee8-ac12-cb61617da3df, pool_id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 415fbcd4-835e-48f9-80c0-fa4771397f90, pool_id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: e689105e-c1fd-49f6-9d05-cf9c9ff4b257, pool_id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 09bd0940-842b-4337-8ff9-3433ced817d7, pool_id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 26ac119a-ed0e-4c78-9b01-fbabb113ff81, pool_id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 21ae1e49-dc39-4a9e-b141-ce6c1656094b, pool_id: 127f2afe-c507-4a93-ad56-3834e79f35c8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 047bf39a-9e55-4a5f-9424-2705cc91df70, pool_id: 31801aa5-cbc2-46ad-8317-204ec0a5cef6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 2048b145-d9d9-460e-8a7f-4f96c8424ea7, pool_id: 5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 2982f117-0191-4a47-a7e5-39725806f2f4, pool_id: b755abc1-d573-403a-80b5-740c5b5b87fd (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:381
2402024-05-23T04:06:45.796ZINFOSledAgent (StorageManager): No ledger in /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2412024-05-23T04:06:45.796ZINFOSledAgent (StorageManager): No ledger in /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2422024-05-23T04:06:45.796ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2432024-05-23T04:06:45.796ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2442024-05-23T04:06:45.796ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:379
2452024-05-23T04:06:45.796ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2462024-05-23T04:06:45.796ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2472024-05-23T04:06:45.909ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:304
2482024-05-23T04:06:45.909ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool)
2492024-05-23T04:06:46.292ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 950.856425ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2502024-05-23T04:06:46.738ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2512024-05-23T04:06:46.935ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }
2522024-05-23T04:06:47.126ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:332
2532024-05-23T04:06:47.126ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:334
2542024-05-23T04:06:47.126ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:338
2552024-05-23T04:06:47.126ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:340
2562024-05-23T04:06:47.126ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2572024-05-23T04:06:47.126ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2582024-05-23T04:06:47.126ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2592024-05-23T04:06:47.329ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.010984296s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2602024-05-23T04:06:47.523ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2612024-05-23T04:06:47.719ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2622024-05-23T04:06:47.918ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2632024-05-23T04:06:48.114ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2642024-05-23T04:06:48.359ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crypt/zone file = sled-storage/src/dataset.rs:395
2652024-05-23T04:06:48.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 54.59283ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2662024-05-23T04:06:49.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 149.422172ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2672024-05-23T04:06:49.115ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2682024-05-23T04:06:49.724ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.99289301s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2692024-05-23T04:06:49.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 283.863982ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2702024-05-23T04:06:49.724ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2712024-05-23T04:06:50.509ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2722024-05-23T04:06:50.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 448.535857ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2732024-05-23T04:06:51.246ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173 file = sled-storage/src/dataset.rs:480
2742024-05-23T04:06:51.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 790.068574ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2752024-05-23T04:06:51.491ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:477
2762024-05-23T04:06:51.491ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:394
2772024-05-23T04:06:51.491ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:379
2782024-05-23T04:06:51.491ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2792024-05-23T04:06:51.491ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2802024-05-23T04:06:51.740ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:304
2812024-05-23T04:06:51.740ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 6104f922-62c0-4d69-bcb4-36106df31285 (zpool)
2822024-05-23T04:06:52.907ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }
2832024-05-23T04:06:53.160ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:332
2842024-05-23T04:06:53.160ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:334
2852024-05-23T04:06:53.160ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:338
2862024-05-23T04:06:53.160ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:340
2872024-05-23T04:06:53.160ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2882024-05-23T04:06:53.417ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-05-23T04:06:53.417ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2902024-05-23T04:06:54.148ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2912024-05-23T04:06:54.149ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2922024-05-23T04:06:54.892ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2932024-05-23T04:06:55.400ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2942024-05-23T04:06:55.401ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2952024-05-23T04:06:55.401ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6104f922-62c0-4d69-bcb4-36106df31285/crypt/zone file = sled-storage/src/dataset.rs:395
2962024-05-23T04:06:55.902ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.814714634s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2972024-05-23T04:06:56.131ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
2982024-05-23T04:06:56.239ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6104f922-62c0-4d69-bcb4-36106df31285 file = sled-storage/src/dataset.rs:480
2992024-05-23T04:06:56.248ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:477
3002024-05-23T04:06:56.248ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:394
3012024-05-23T04:06:56.248ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:379
3022024-05-23T04:06:56.248ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3032024-05-23T04:06:56.248ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3042024-05-23T04:06:56.258ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:304
3052024-05-23T04:06:56.258ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool)
3062024-05-23T04:06:56.352ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }
3072024-05-23T04:06:56.361ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:332
3082024-05-23T04:06:56.361ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3092024-05-23T04:06:56.361ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3102024-05-23T04:06:56.361ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3112024-05-23T04:06:56.361ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-05-23T04:06:56.361ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132024-05-23T04:06:56.361ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3142024-05-23T04:06:56.397ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152024-05-23T04:06:56.402ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
3162024-05-23T04:06:56.405ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec/crypt/zone file = sled-storage/src/dataset.rs:395
3172024-05-23T04:06:56.530ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec file = sled-storage/src/dataset.rs:480
3182024-05-23T04:06:56.538ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:477
3192024-05-23T04:06:56.538ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:394
3202024-05-23T04:06:56.538ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:379
3212024-05-23T04:06:56.538ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3222024-05-23T04:06:56.538ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232024-05-23T04:06:56.547ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:304
3242024-05-23T04:06:56.547ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool)
3252024-05-23T04:06:56.641ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External }
3262024-05-23T04:06:56.649ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:332
3272024-05-23T04:06:56.649ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:334
3282024-05-23T04:06:56.649ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:338
3292024-05-23T04:06:56.649ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:340
3302024-05-23T04:06:56.649ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-05-23T04:06:56.649ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322024-05-23T04:06:56.649ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3332024-05-23T04:06:56.683ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3342024-05-23T04:06:56.691ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7a0ba1c9-0994-46ee-848a-8efaae776d11/crypt/zone file = sled-storage/src/dataset.rs:395
3352024-05-23T04:06:56.814ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7a0ba1c9-0994-46ee-848a-8efaae776d11 file = sled-storage/src/dataset.rs:480
3362024-05-23T04:06:56.822ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:477
3372024-05-23T04:06:56.822ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:394
3382024-05-23T04:06:56.822ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:379
3392024-05-23T04:06:56.822ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3402024-05-23T04:06:56.822ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412024-05-23T04:06:56.831ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:304
3422024-05-23T04:06:56.831ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool)
3432024-05-23T04:06:56.922ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External }
3442024-05-23T04:06:56.930ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:332
3452024-05-23T04:06:56.930ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:334
3462024-05-23T04:06:56.930ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:338
3472024-05-23T04:06:56.930ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:340
3482024-05-23T04:06:56.930ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-05-23T04:06:56.930ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502024-05-23T04:06:56.930ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3512024-05-23T04:06:56.964ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522024-05-23T04:06:56.973ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a/crypt/zone file = sled-storage/src/dataset.rs:395
3532024-05-23T04:06:57.095ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a file = sled-storage/src/dataset.rs:480
3542024-05-23T04:06:57.103ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:477
3552024-05-23T04:06:57.103ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:394
3562024-05-23T04:06:57.103ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:379
3572024-05-23T04:06:57.103ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3582024-05-23T04:06:57.103ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592024-05-23T04:06:57.112ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:304
3602024-05-23T04:06:57.113ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 127f2afe-c507-4a93-ad56-3834e79f35c8 (zpool)
3612024-05-23T04:06:57.207ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 127f2afe-c507-4a93-ad56-3834e79f35c8 (zpool), kind: External }
3622024-05-23T04:06:57.215ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:332
3632024-05-23T04:06:57.215ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:334
3642024-05-23T04:06:57.215ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:338
3652024-05-23T04:06:57.215ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:340
3662024-05-23T04:06:57.215ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-05-23T04:06:57.215ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-05-23T04:06:57.215ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3692024-05-23T04:06:57.251ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702024-05-23T04:06:57.259ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_127f2afe-c507-4a93-ad56-3834e79f35c8/crypt/zone file = sled-storage/src/dataset.rs:395
3712024-05-23T04:06:57.345ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2303
3722024-05-23T04:06:57.387ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_127f2afe-c507-4a93-ad56-3834e79f35c8 file = sled-storage/src/dataset.rs:480
3732024-05-23T04:06:57.395ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:477
3742024-05-23T04:06:57.395ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:394
3752024-05-23T04:06:57.395ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:379
3762024-05-23T04:06:57.395ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3772024-05-23T04:06:57.395ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3782024-05-23T04:06:57.405ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:304
3792024-05-23T04:06:57.405ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 31801aa5-cbc2-46ad-8317-204ec0a5cef6 (zpool)
3802024-05-23T04:06:57.497ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 31801aa5-cbc2-46ad-8317-204ec0a5cef6 (zpool), kind: External }
3812024-05-23T04:06:57.505ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:332
3822024-05-23T04:06:57.505ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:334
3832024-05-23T04:06:57.505ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:338
3842024-05-23T04:06:57.505ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:340
3852024-05-23T04:06:57.505ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-05-23T04:06:57.506ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872024-05-23T04:06:57.506ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3882024-05-23T04:06:57.510ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
3892024-05-23T04:06:57.510ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
3902024-05-23T04:06:57.540ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3912024-05-23T04:06:57.548ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_31801aa5-cbc2-46ad-8317-204ec0a5cef6/crypt/zone file = sled-storage/src/dataset.rs:395
3922024-05-23T04:06:57.670ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_31801aa5-cbc2-46ad-8317-204ec0a5cef6 file = sled-storage/src/dataset.rs:480
3932024-05-23T04:06:57.678ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:477
3942024-05-23T04:06:57.678ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:394
3952024-05-23T04:06:57.678ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:379
3962024-05-23T04:06:57.678ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3972024-05-23T04:06:57.678ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3982024-05-23T04:06:57.688ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:304
3992024-05-23T04:06:57.688ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d (zpool)
4002024-05-23T04:06:57.782ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d (zpool), kind: External }
4012024-05-23T04:06:57.789ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:332
4022024-05-23T04:06:57.789ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:334
4032024-05-23T04:06:57.789ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:338
4042024-05-23T04:06:57.789ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:340
4052024-05-23T04:06:57.789ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4062024-05-23T04:06:57.790ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-05-23T04:06:57.790ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4082024-05-23T04:06:57.826ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4092024-05-23T04:06:57.835ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d/crypt/zone file = sled-storage/src/dataset.rs:395
4102024-05-23T04:06:57.956ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d file = sled-storage/src/dataset.rs:480
4112024-05-23T04:06:57.963ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:477
4122024-05-23T04:06:57.963ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:394
4132024-05-23T04:06:57.963ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:379
4142024-05-23T04:06:57.963ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
4152024-05-23T04:06:57.963ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4162024-05-23T04:06:57.973ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:304
4172024-05-23T04:06:57.973ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = b755abc1-d573-403a-80b5-740c5b5b87fd (zpool)
4182024-05-23T04:06:58.066ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: b755abc1-d573-403a-80b5-740c5b5b87fd (zpool), kind: External }
4192024-05-23T04:06:58.073ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:332
4202024-05-23T04:06:58.073ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:334
4212024-05-23T04:06:58.073ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:338
4222024-05-23T04:06:58.073ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:340
4232024-05-23T04:06:58.073ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242024-05-23T04:06:58.074ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4252024-05-23T04:06:58.074ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4262024-05-23T04:06:58.109ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4272024-05-23T04:06:58.117ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b755abc1-d573-403a-80b5-740c5b5b87fd/crypt/zone file = sled-storage/src/dataset.rs:395
4282024-05-23T04:06:58.240ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b755abc1-d573-403a-80b5-740c5b5b87fd file = sled-storage/src/dataset.rs:480
4292024-05-23T04:06:58.248ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:477
4302024-05-23T04:06:58.248ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:394
4312024-05-23T04:06:58.248ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322024-05-23T04:06:58.248ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 00f23dd2-ec1c-47ae-955f-67169b6e6535 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: dc107f05-7499-4442-b1eb-bd9424553a87 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: 127f2afe-c507-4a93-ad56-3834e79f35c8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: 31801aa5-cbc2-46ad-8317-204ec0a5cef6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: 5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: b755abc1-d573-403a-80b5-740c5b5b87fd (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4332024-05-23T04:06:58.248ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
4342024-05-23T04:06:58.248ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
4352024-05-23T04:06:58.248ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4362024-05-23T04:06:58.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 12453031 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61030 req_id = 6018d663-ff46-43e4-81ce-d51a41a06097 response_code = 200 uri = /omicron-physical-disks
4372024-05-23T04:06:58.279ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
4382024-05-23T04:06:58.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56830
4392024-05-23T04:06:58.280ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4402024-05-23T04:06:58.280ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4412024-05-23T04:06:58.329ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4422024-05-23T04:06:58.329ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4432024-05-23T04:06:58.377ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4442024-05-23T04:06:58.377ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
4452024-05-23T04:06:58.426ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4462024-05-23T04:06:58.427ZINFOSledAgent (ServiceManager): No ledger in /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/omicron-zones.json file = common/src/ledger.rs:188
4472024-05-23T04:06:58.427ZINFOSledAgent (ServiceManager): No ledger in /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/omicron-zones.json file = common/src/ledger.rs:188
4482024-05-23T04:06:58.427ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4492024-05-23T04:06:58.470ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4502024-05-23T04:06:58.470ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4512024-05-23T04:06:58.470ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4522024-05-23T04:06:58.512ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
4532024-05-23T04:06:58.522ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568 file = illumos-utils/src/zone.rs:315
4542024-05-23T04:06:58.525ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0 file = illumos-utils/src/zone.rs:315
4552024-05-23T04:06:58.529ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd file = illumos-utils/src/zone.rs:315
4562024-05-23T04:06:58.541ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568 file = illumos-utils/src/zone.rs:354
4572024-05-23T04:06:58.546ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0 file = illumos-utils/src/zone.rs:354
4582024-05-23T04:06:58.550ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd file = illumos-utils/src/zone.rs:354
4592024-05-23T04:06:59.508ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
4602024-05-23T04:06:59.514ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
4612024-05-23T04:07:00.044ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4622024-05-23T04:07:00.044ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4632024-05-23T04:07:00.523ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4642024-05-23T04:07:00.523ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
4652024-05-23T04:07:01.005ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4662024-05-23T04:07:01.005ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4672024-05-23T04:07:01.005ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4682024-05-23T04:07:01.005ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
4692024-05-23T04:07:01.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 62.012605ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
4702024-05-23T04:07:01.019ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
4712024-05-23T04:07:01.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 118.665293ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
4722024-05-23T04:07:01.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 52.640358ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
4732024-05-23T04:07:01.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 63.340351ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
4742024-05-23T04:07:01.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 82.95071ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
4752024-05-23T04:07:01.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 53.765333ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
4762024-05-23T04:07:01.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 177.172081ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
4772024-05-23T04:07:01.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 111.819165ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
4782024-05-23T04:07:01.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 140.555085ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
4792024-05-23T04:07:01.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 432.142575ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
4802024-05-23T04:07:01.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 322.375368ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
4812024-05-23T04:07:01.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 516.552132ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
4822024-05-23T04:07:01.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 688.642156ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
4832024-05-23T04:07:02.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 1.191511072s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
4842024-05-23T04:07:02.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 636.610636ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
4852024-05-23T04:07:02.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 1.001614204s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
4862024-05-23T04:07:02.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 1.330913199s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
4872024-05-23T04:07:03.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 591.394718ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
4882024-05-23T04:07:03.424ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:a02a::2 exists in switch zone file = sled-agent/src/services.rs:2320
4892024-05-23T04:07:03.424ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4902024-05-23T04:07:03.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 814.891916ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
4912024-05-23T04:07:03.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 966.922942ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
4922024-05-23T04:07:03.978ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fe75:95db file = sled-agent/src/services.rs:2327
4932024-05-23T04:07:03.985ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2388
4942024-05-23T04:07:04.118ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2573
4952024-05-23T04:07:04.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 501.732749ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
4962024-05-23T04:07:04.385ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2737
4972024-05-23T04:07:04.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 1.218064084s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
4982024-05-23T04:07:04.582ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2452
4992024-05-23T04:07:04.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 1.089096903s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
5002024-05-23T04:07:04.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 1.191474289s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
5012024-05-23T04:07:04.876ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2487
5022024-05-23T04:07:05.074ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2787
5032024-05-23T04:07:05.245ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2814
5042024-05-23T04:07:05.449ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2681
5052024-05-23T04:07:05.613ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2481
5062024-05-23T04:07:05.622ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3873 new = [fd00:1122:3344:101::2, ::1] old = [::1]
5072024-05-23T04:07:05.622ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3889
5082024-05-23T04:07:05.622ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
5092024-05-23T04:07:05.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 1.188356042s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
5102024-05-23T04:07:05.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 736.910083ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
5112024-05-23T04:07:05.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 1.011469503s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
5122024-05-23T04:07:06.167ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3897
5132024-05-23T04:07:06.173ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3953
5142024-05-23T04:07:06.305ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4015
5152024-05-23T04:07:06.401ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3996 rack_subnet = fd00:1122:3344::
5162024-05-23T04:07:06.423ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4043
5172024-05-23T04:07:06.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd") failed: Property not found. retry in 781.696155ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
5182024-05-23T04:07:06.523ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4070
5192024-05-23T04:07:06.648ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:365
5202024-05-23T04:07:06.684ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:413
5212024-05-23T04:07:06.715ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:651
5222024-05-23T04:07:06.715ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:689
5232024-05-23T04:07:06.716ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:692 uptime = 2
5242024-05-23T04:07:06.716ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:435
5252024-05-23T04:07:06.790ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5262024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5272024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5282024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5292024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5302024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5312024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5322024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5332024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5342024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5352024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5362024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5372024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5382024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5392024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5402024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5412024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5422024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5432024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5442024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5452024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5462024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5472024-05-23T04:07:06.790ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5482024-05-23T04:07:06.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568") failed: Property not found. retry in 916.5803ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
5492024-05-23T04:07:07.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0") failed: Property not found. retry in 1.418290308s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
5502024-05-23T04:07:08.442ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_5e18fd22-8f93-470c-8e9a-dcf9298b8568
5512024-05-23T04:07:08.442ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_3c4a2e19-a9df-4151-9dda-0677680ad2d0
5522024-05-23T04:07:08.442ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_internal_dns_060a01a4-ea60-49b9-9e88-edf5266ddbcd
5532024-05-23T04:07:08.442ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5542024-05-23T04:07:08.442ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5552024-05-23T04:07:08.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 10163211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56830 req_id = 9611df4f-5c09-4813-b784-0157cd1f2269 response_code = 204 uri = /omicron-zones
5562024-05-23T04:07:08.444ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:548
5572024-05-23T04:07:09.649ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:548
5582024-05-23T04:07:09.730ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:548
5592024-05-23T04:07:09.812ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:584
5602024-05-23T04:07:09.812ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5612024-05-23T04:07:09.844ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5622024-05-23T04:07:09.845ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5632024-05-23T04:07:09.845ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5642024-05-23T04:07:09.874ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6672c6aa-40ee-4a8b-98e3-e6a94a2240c9, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d71ec52c-5013-463a-8d1b-f1ddff885b20, kind: Service { id: 6672c6aa-40ee-4a8b-98e3-e6a94a2240c9 }, name: Name("ntp-6672c6aa-40ee-4a8b-98e3-e6a94a2240c9"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 238])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
5652024-05-23T04:07:09.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39122
5662024-05-23T04:07:09.874ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5672024-05-23T04:07:09.874ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5682024-05-23T04:07:09.896ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5692024-05-23T04:07:09.896ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5702024-05-23T04:07:09.914ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5712024-05-23T04:07:09.914ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
5722024-05-23T04:07:09.932ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5732024-05-23T04:07:09.932ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/omicron-zones.json file = common/src/ledger.rs:177
5742024-05-23T04:07:09.933ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/omicron-zones.json file = common/src/ledger.rs:177
5752024-05-23T04:07:09.933ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5762024-05-23T04:07:09.944ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5772024-05-23T04:07:09.975ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5782024-05-23T04:07:09.976ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5792024-05-23T04:07:09.976ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5802024-05-23T04:07:10.021ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 170, 238]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5812024-05-23T04:07:10.021ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = ntp
5822024-05-23T04:07:10.022ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
5832024-05-23T04:07:10.022ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
5842024-05-23T04:07:10.022ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
5852024-05-23T04:07:10.024ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5862024-05-23T04:07:10.046ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9 file = illumos-utils/src/zone.rs:315
5872024-05-23T04:07:10.065ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9 file = illumos-utils/src/zone.rs:354
5882024-05-23T04:07:10.163ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42615
5892024-05-23T04:07:10.163ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42615 req_id = adf28c9a-34b3-4df6-8332-59515e376479 response_code = 200 uri = /baseboard
5902024-05-23T04:07:10.683ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5912024-05-23T04:07:10.683ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
5922024-05-23T04:07:10.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9") failed: Property not found. retry in 65.68423ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
5932024-05-23T04:07:10.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9") failed: Property not found. retry in 108.097804ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
5942024-05-23T04:07:11.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9") failed: Property not found. retry in 169.32539ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
5952024-05-23T04:07:11.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9") failed: Property not found. retry in 323.119369ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
5962024-05-23T04:07:11.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9") failed: Property not found. retry in 1.015194607s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
5972024-05-23T04:07:12.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9") failed: Property not found. retry in 1.245199137s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
5982024-05-23T04:07:13.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9") failed: Property not found. retry in 947.567581ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
5992024-05-23T04:07:14.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9") failed: Property not found. retry in 617.317421ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
6002024-05-23T04:07:15.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9") failed: Property not found. retry in 937.87531ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
6012024-05-23T04:07:16.364ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9
6022024-05-23T04:07:16.364ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6032024-05-23T04:07:16.364ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6042024-05-23T04:07:16.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 6490375 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39122 req_id = 7cfb4601-b629-49a1-8dfc-3bf14cda5fb7 response_code = 204 uri = /omicron-zones
6052024-05-23T04:07:16.366ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:625
6062024-05-23T04:07:16.395ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6072024-05-23T04:07:16.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33381
6082024-05-23T04:07:16.404ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6092024-05-23T04:07:16.404ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:866 latency_us = 9337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33381 req_id = dd7ec78d-6229-4e64-a50a-6243d1c3b3ff response_code = 500 uri = /timesync
6102024-05-23T04:07:16.406ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6112024-05-23T04:07:16.518ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6122024-05-23T04:07:16.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41104
6132024-05-23T04:07:20.526ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6142024-05-23T04:07:20.527ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:866 latency_us = 4008541 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41104 req_id = bb29aa26-b63d-47b5-9e81-dd22b549dd75 response_code = 500 uri = /timesync
6152024-05-23T04:07:20.529ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6162024-05-23T04:07:20.666ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6172024-05-23T04:07:20.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56642
6182024-05-23T04:07:20.675ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6192024-05-23T04:07:20.675ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:866 latency_us = 8767 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56642 req_id = 9070d5ea-0507-43b4-bebc-993865af1f6c response_code = 500 uri = /timesync
6202024-05-23T04:07:20.678ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6212024-05-23T04:07:20.804ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6222024-05-23T04:07:20.804ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41164
6232024-05-23T04:07:24.814ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6672c6aa-40ee-4a8b-98e3-e6a94a2240c9': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3603
6242024-05-23T04:07:24.814ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:866 latency_us = 4009530 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41164 req_id = 018db678-dde4-49f8-ad49-34743e273121 response_code = 500 uri = /timesync
6252024-05-23T04:07:24.817ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6262024-05-23T04:07:25.065ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6272024-05-23T04:07:25.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37543
6282024-05-23T04:07:25.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8805 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37543 req_id = be783473-03ca-4fb9-9e03-d2d957e7c9ee response_code = 200 uri = /timesync
6292024-05-23T04:07:25.076ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6302024-05-23T04:07:25.076ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6312024-05-23T04:07:25.419ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6322024-05-23T04:07:25.419ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53091
6332024-05-23T04:07:25.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 7826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53091 req_id = 9b41e5af-69d0-4241-ae8b-39e2cc55f188 response_code = 200 uri = /timesync
6342024-05-23T04:07:25.429ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6352024-05-23T04:07:25.429ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6362024-05-23T04:07:25.677ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6372024-05-23T04:07:25.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42672
6382024-05-23T04:07:25.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8507 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42672 req_id = 1fd80985-12bb-43ef-b0d3-91af05811aca response_code = 200 uri = /timesync
6392024-05-23T04:07:25.688ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6402024-05-23T04:07:25.688ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6412024-05-23T04:07:25.757ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 207.428013ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
6422024-05-23T04:07:26.064ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6432024-05-23T04:07:26.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48087
6442024-05-23T04:07:26.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 7429 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48087 req_id = d5fd2aad-6f98-4d63-9ea3-7154a2f826dd response_code = 200 uri = /timesync
6452024-05-23T04:07:26.073ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6462024-05-23T04:07:26.073ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6472024-05-23T04:07:26.388ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6482024-05-23T04:07:26.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51556
6492024-05-23T04:07:26.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8080 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51556 req_id = a0dc24c3-24af-43f2-a7a2-224ede52ee1d response_code = 200 uri = /timesync
6502024-05-23T04:07:26.399ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6512024-05-23T04:07:26.399ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6522024-05-23T04:07:27.032ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6532024-05-23T04:07:27.032ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49882
6542024-05-23T04:07:27.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9066 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49882 req_id = 1c94fc73-0f1f-42b1-a8ed-f7bb3ec04ffc response_code = 200 uri = /timesync
6552024-05-23T04:07:27.044ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6562024-05-23T04:07:27.044ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6572024-05-23T04:07:27.832ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6582024-05-23T04:07:27.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34958
6592024-05-23T04:07:27.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8611 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34958 req_id = 2fe5703b-566a-4100-bc7d-79e4de463769 response_code = 200 uri = /timesync
6602024-05-23T04:07:27.843ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6612024-05-23T04:07:27.843ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6622024-05-23T04:07:29.305ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6632024-05-23T04:07:29.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43845
6642024-05-23T04:07:29.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8566 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43845 req_id = ef5c77fc-54e4-4516-acb2-f56f9fe5bbdf response_code = 200 uri = /timesync
6652024-05-23T04:07:29.316ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:633
6662024-05-23T04:07:29.316ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6672024-05-23T04:07:30.400ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6682024-05-23T04:07:30.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53051
6692024-05-23T04:07:30.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53051 req_id = 1a95d940-56ab-4311-817b-383b20508d20 response_code = 200 uri = /timesync
6702024-05-23T04:07:30.410ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.385043859 } file = sled-agent/src/rack_setup/service.rs:633
6712024-05-23T04:07:30.410ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6722024-05-23T04:07:31.696ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6732024-05-23T04:07:31.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39539
6742024-05-23T04:07:31.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 7874 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39539 req_id = 83602c5f-4207-470c-bd35-98031b30f44d response_code = 200 uri = /timesync
6752024-05-23T04:07:31.706ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.381525338 } file = sled-agent/src/rack_setup/service.rs:633
6762024-05-23T04:07:31.706ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6772024-05-23T04:07:32.740ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6782024-05-23T04:07:32.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38705
6792024-05-23T04:07:32.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8046 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38705 req_id = 3ad58943-eb51-4a2a-aa64-149b8d003843 response_code = 200 uri = /timesync
6802024-05-23T04:07:32.751ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.378688931 } file = sled-agent/src/rack_setup/service.rs:633
6812024-05-23T04:07:32.751ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6822024-05-23T04:07:33.685ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6832024-05-23T04:07:33.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62350
6842024-05-23T04:07:33.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 7099 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62350 req_id = cf73533e-3fc9-4798-adae-7b63711a6c3f response_code = 200 uri = /timesync
6852024-05-23T04:07:33.694ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.376124531 } file = sled-agent/src/rack_setup/service.rs:633
6862024-05-23T04:07:33.695ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6872024-05-23T04:07:34.744ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6882024-05-23T04:07:34.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57032
6892024-05-23T04:07:34.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9030 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57032 req_id = 5841ee0e-221f-4533-9128-345e9ec374bb response_code = 200 uri = /timesync
6902024-05-23T04:07:34.756ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.373244971 } file = sled-agent/src/rack_setup/service.rs:633
6912024-05-23T04:07:34.756ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6922024-05-23T04:07:36.556ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6932024-05-23T04:07:36.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49816
6942024-05-23T04:07:36.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8922 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49816 req_id = b7244a0c-af9e-4cf9-94aa-e182f55401d7 response_code = 200 uri = /timesync
6952024-05-23T04:07:36.568ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.36832419 } file = sled-agent/src/rack_setup/service.rs:633
6962024-05-23T04:07:36.568ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
6972024-05-23T04:07:37.830ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
6982024-05-23T04:07:37.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51757
6992024-05-23T04:07:37.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51757 req_id = 6773f201-d3bc-4d44-a7d7-46d628fd00f0 response_code = 200 uri = /timesync
7002024-05-23T04:07:37.841ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.364865333 } file = sled-agent/src/rack_setup/service.rs:633
7012024-05-23T04:07:37.841ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7022024-05-23T04:07:40.745ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63930
7032024-05-23T04:07:40.745ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63930 req_id = d36d4b9a-4401-4d3e-a78f-cf6fdb067a3e response_code = 200 uri = /baseboard
7042024-05-23T04:07:41.510ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7052024-05-23T04:07:41.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37265
7062024-05-23T04:07:41.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8895 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37265 req_id = 907025b5-023d-48aa-b245-0916387205b6 response_code = 200 uri = /timesync
7072024-05-23T04:07:41.521ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.354870826 } file = sled-agent/src/rack_setup/service.rs:633
7082024-05-23T04:07:41.521ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7092024-05-23T04:07:41.541ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 645.957255ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
7102024-05-23T04:07:46.183ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7112024-05-23T04:07:46.184ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42055
7122024-05-23T04:07:46.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9623 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42055 req_id = edbe8573-c57c-4b5f-9d43-262eaa1e898b response_code = 200 uri = /timesync
7132024-05-23T04:07:46.196ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.342176944 } file = sled-agent/src/rack_setup/service.rs:633
7142024-05-23T04:07:46.196ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7152024-05-23T04:07:51.287ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7162024-05-23T04:07:51.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54637
7172024-05-23T04:07:51.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8880 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54637 req_id = cda6dbdb-bed9-465e-9158-d98318b45357 response_code = 200 uri = /timesync
7182024-05-23T04:07:51.299ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.32831797 } file = sled-agent/src/rack_setup/service.rs:633
7192024-05-23T04:07:51.299ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7202024-05-23T04:07:57.177ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 941.108245ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
7212024-05-23T04:07:58.066ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7222024-05-23T04:07:58.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51696
7232024-05-23T04:07:58.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51696 req_id = 1d910173-7f95-4dfc-b527-88fe5b1fa757 response_code = 200 uri = /timesync
7242024-05-23T04:07:58.078ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1716437276.8567753, correction: -0.310391396 } file = sled-agent/src/rack_setup/service.rs:633
7252024-05-23T04:07:58.078ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7262024-05-23T04:08:03.817ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7272024-05-23T04:08:03.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61415
7282024-05-23T04:08:03.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9567 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61415 req_id = 87be3efb-67b7-4559-81cb-ababf57a7ae2 response_code = 200 uri = /timesync
7292024-05-23T04:08:03.830ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1716437276.8567753, correction: -0.294772863 } file = sled-agent/src/rack_setup/service.rs:633
7302024-05-23T04:08:03.830ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7312024-05-23T04:08:10.697ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62481
7322024-05-23T04:08:10.698ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62481 req_id = 31587d71-d1b7-4f40-a578-acebb255516a response_code = 200 uri = /baseboard
7332024-05-23T04:08:12.323ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7342024-05-23T04:08:12.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39545
7352024-05-23T04:08:12.333ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39545 req_id = af023aec-f298-4328-bac9-ee4c823c10e0 response_code = 200 uri = /timesync
7362024-05-23T04:08:12.336ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1716437276.8567753, correction: -0.271672398 } file = sled-agent/src/rack_setup/service.rs:633
7372024-05-23T04:08:12.336ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7382024-05-23T04:08:13.108ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.700797929s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
7392024-05-23T04:08:20.458ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7402024-05-23T04:08:20.458ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45091
7412024-05-23T04:08:20.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8961 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45091 req_id = 2eab9146-f6ab-467a-8308-b7c630a2a71a response_code = 200 uri = /timesync
7422024-05-23T04:08:20.469ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1716437276.8567753, correction: -0.249583319 } file = sled-agent/src/rack_setup/service.rs:633
7432024-05-23T04:08:20.469ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7442024-05-23T04:08:29.800ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.115903344s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
7452024-05-23T04:08:33.326ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7462024-05-23T04:08:33.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50907
7472024-05-23T04:08:33.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8972 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50907 req_id = 4eef3aa1-705e-485f-8392-a529f7a83e9f response_code = 200 uri = /timesync
7482024-05-23T04:08:33.338ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1716437276.8567753, correction: -0.214635819 } file = sled-agent/src/rack_setup/service.rs:633
7492024-05-23T04:08:33.338ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7502024-05-23T04:08:40.650ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57422
7512024-05-23T04:08:40.650ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57422 req_id = 91d3a31b-7e5f-4268-9817-b16033846c19 response_code = 200 uri = /baseboard
7522024-05-23T04:08:46.904ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.524324887s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
7532024-05-23T04:08:48.808ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7542024-05-23T04:08:48.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62052
7552024-05-23T04:08:48.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62052 req_id = aed60e93-b20f-41fa-bc54-1e7b66374c05 response_code = 200 uri = /timesync
7562024-05-23T04:08:48.821ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1716437276.8567753, correction: -0.172589898 } file = sled-agent/src/rack_setup/service.rs:633
7572024-05-23T04:08:48.821ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7582024-05-23T04:09:04.979ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7592024-05-23T04:09:04.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50485
7602024-05-23T04:09:04.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 8894 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50485 req_id = 83bc66fd-0840-4555-8180-255dac12a56a response_code = 200 uri = /timesync
7612024-05-23T04:09:04.992ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1716437341.8314488, correction: -0.129609078 } file = sled-agent/src/rack_setup/service.rs:633
7622024-05-23T04:09:04.992ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7632024-05-23T04:09:10.602ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46533
7642024-05-23T04:09:10.602ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 50 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46533 req_id = 55cb390d-6562-4b59-8cd5-8f050478f348 response_code = 200 uri = /baseboard
7652024-05-23T04:09:12.394ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 14.73152266s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
7662024-05-23T04:09:22.674ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7672024-05-23T04:09:22.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60174
7682024-05-23T04:09:22.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 9340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60174 req_id = b8bf2f50-7cb2-47eb-9ea4-80739aaf5b58 response_code = 200 uri = /timesync
7692024-05-23T04:09:22.686ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1716437341.8314488, correction: -0.081553683 } file = sled-agent/src/rack_setup/service.rs:633
7702024-05-23T04:09:22.686ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:655
7712024-05-23T04:09:40.302ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:605
7722024-05-23T04:09:40.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62337
7732024-05-23T04:09:40.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 22398 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62337 req_id = c22472cc-8a7a-48bc-816a-362fad83a853 response_code = 200 uri = /timesync
7742024-05-23T04:09:40.328ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1753455535, ip_addr: 104.131.155.175, stratum: 3, ref_time: 1716437341.8314488, correction: -0.03367871 } file = sled-agent/src/rack_setup/service.rs:633
7752024-05-23T04:09:40.328ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1216
7762024-05-23T04:09:40.356ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6672c6aa-40ee-4a8b-98e3-e6a94a2240c9, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d71ec52c-5013-463a-8d1b-f1ddff885b20, kind: Service { id: 6672c6aa-40ee-4a8b-98e3-e6a94a2240c9 }, name: Name("ntp-6672c6aa-40ee-4a8b-98e3-e6a94a2240c9"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 238])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: d2b07c28-e592-41ef-a5c3-12abb0c287a0, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0991fc60-db92-48bd-98ab-c75e1b5f8602, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External } } } }, OmicronZoneConfig { id: d88a5bfa-e8e5-4978-96bb-9cc102bbcb83, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External } } } }, OmicronZoneConfig { id: c684ab4f-842e-446a-9c72-66d96c373df0, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External } } } }, OmicronZoneConfig { id: acabd678-d607-4318-83ef-dba5de52dcaa, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
7772024-05-23T04:09:40.357ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55479
7782024-05-23T04:09:40.357ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7792024-05-23T04:09:40.357ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7802024-05-23T04:09:40.377ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7812024-05-23T04:09:40.377ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822024-05-23T04:09:40.396ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
7832024-05-23T04:09:40.396ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842024-05-23T04:09:40.415ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d2b07c28-e592-41ef-a5c3-12abb0c287a0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7852024-05-23T04:09:40.415ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d2b07c28-e592-41ef-a5c3-12abb0c287a0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7862024-05-23T04:09:40.484ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0991fc60-db92-48bd-98ab-c75e1b5f8602, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7872024-05-23T04:09:40.484ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0991fc60-db92-48bd-98ab-c75e1b5f8602, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7882024-05-23T04:09:40.549ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d88a5bfa-e8e5-4978-96bb-9cc102bbcb83, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7892024-05-23T04:09:40.549ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d88a5bfa-e8e5-4978-96bb-9cc102bbcb83, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7902024-05-23T04:09:40.555ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58987
7912024-05-23T04:09:40.556ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 123 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58987 req_id = 24b9c916-3d15-4134-b1ce-18127a9b63cd response_code = 200 uri = /baseboard
7922024-05-23T04:09:40.617ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c684ab4f-842e-446a-9c72-66d96c373df0, dataset_name: DatasetName { pool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7932024-05-23T04:09:40.617ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c684ab4f-842e-446a-9c72-66d96c373df0, dataset_name: DatasetName { pool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7942024-05-23T04:09:40.681ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: acabd678-d607-4318-83ef-dba5de52dcaa, dataset_name: DatasetName { pool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
7952024-05-23T04:09:40.681ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: acabd678-d607-4318-83ef-dba5de52dcaa, dataset_name: DatasetName { pool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7962024-05-23T04:09:40.748ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
7972024-05-23T04:09:40.748ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/omicron-zones.json file = common/src/ledger.rs:177
7982024-05-23T04:09:40.748ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/omicron-zones.json file = common/src/ledger.rs:177
7992024-05-23T04:09:40.748ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8002024-05-23T04:09:40.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8012024-05-23T04:09:40.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8022024-05-23T04:09:40.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8032024-05-23T04:09:40.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8042024-05-23T04:09:40.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8052024-05-23T04:09:40.924ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602 file = illumos-utils/src/zone.rs:315
8062024-05-23T04:09:40.928ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0 file = illumos-utils/src/zone.rs:315
8072024-05-23T04:09:40.932ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0 file = illumos-utils/src/zone.rs:315
8082024-05-23T04:09:40.937ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83 file = illumos-utils/src/zone.rs:315
8092024-05-23T04:09:40.941ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa file = illumos-utils/src/zone.rs:315
8102024-05-23T04:09:40.946ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602 file = illumos-utils/src/zone.rs:354
8112024-05-23T04:09:40.951ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0 file = illumos-utils/src/zone.rs:354
8122024-05-23T04:09:40.955ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0 file = illumos-utils/src/zone.rs:354
8132024-05-23T04:09:40.959ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83 file = illumos-utils/src/zone.rs:354
8142024-05-23T04:09:40.964ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa file = illumos-utils/src/zone.rs:354
8152024-05-23T04:09:42.081ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 29.590512098s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
8162024-05-23T04:09:43.775ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::4"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8172024-05-23T04:09:43.776ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8182024-05-23T04:09:43.782ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::3"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8192024-05-23T04:09:43.782ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8202024-05-23T04:09:43.807ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::7"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8212024-05-23T04:09:43.807ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8222024-05-23T04:09:43.816ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::5"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8232024-05-23T04:09:43.816ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8242024-05-23T04:09:43.879ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::6"/> <propval type="astring" name="listen_port" value="32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8252024-05-23T04:09:43.879ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8262024-05-23T04:09:43.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 73.669244ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8272024-05-23T04:09:43.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 25.832855ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8282024-05-23T04:09:43.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 56.765124ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8292024-05-23T04:09:43.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 46.735439ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8302024-05-23T04:09:43.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 54.229659ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8312024-05-23T04:09:44.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 63.437324ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8322024-05-23T04:09:44.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 113.329448ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8332024-05-23T04:09:44.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 140.785495ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8342024-05-23T04:09:44.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 137.125931ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8352024-05-23T04:09:44.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 272.512311ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8362024-05-23T04:09:44.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 49.945444ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8372024-05-23T04:09:45.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 233.235761ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8382024-05-23T04:09:45.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 165.683392ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8392024-05-23T04:09:45.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 419.955286ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8402024-05-23T04:09:45.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 400.561189ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8412024-05-23T04:09:46.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 52.197426ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8422024-05-23T04:09:46.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 311.04717ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8432024-05-23T04:09:46.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 516.703565ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8442024-05-23T04:09:46.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 908.148413ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8452024-05-23T04:09:46.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.070609778s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8462024-05-23T04:09:46.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 248.600595ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8472024-05-23T04:09:46.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 1.033511574s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8482024-05-23T04:09:46.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 517.510598ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8492024-05-23T04:09:47.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 870.708682ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8502024-05-23T04:09:47.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 567.354796ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8512024-05-23T04:09:47.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 908.308001ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8522024-05-23T04:09:47.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.373616406s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8532024-05-23T04:09:47.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 687.86417ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8542024-05-23T04:09:47.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 845.981636ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8552024-05-23T04:09:47.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 1.472140412s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8562024-05-23T04:09:48.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 1.363864086s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8572024-05-23T04:09:48.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 1.327021411s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8582024-05-23T04:09:48.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 682.000878ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8592024-05-23T04:09:49.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.296943721s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8602024-05-23T04:09:49.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 1.465567554s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8612024-05-23T04:09:49.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 957.000151ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8622024-05-23T04:09:49.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 505.439339ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8632024-05-23T04:09:49.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 554.743364ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8642024-05-23T04:09:50.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 989.555898ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8652024-05-23T04:09:50.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 633.677107ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8662024-05-23T04:09:50.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.39761276s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8672024-05-23T04:09:50.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 1.170178347s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8682024-05-23T04:09:50.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 946.978662ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8692024-05-23T04:09:50.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 1.30134231s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8702024-05-23T04:09:51.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 1.490002181s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8712024-05-23T04:09:51.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 1.113463135s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8722024-05-23T04:09:51.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 888.184507ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8732024-05-23T04:09:51.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 548.36594ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8742024-05-23T04:09:52.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 765.496535ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8752024-05-23T04:09:52.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 729.059913ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8762024-05-23T04:09:52.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 633.917913ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8772024-05-23T04:09:52.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0") failed: Property not found. retry in 681.436683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
8782024-05-23T04:09:52.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602") failed: Property not found. retry in 651.730923ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
8792024-05-23T04:09:53.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 692.514891ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8802024-05-23T04:09:53.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa") failed: Property not found. retry in 1.062992106s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
8812024-05-23T04:09:53.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 956.66282ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8822024-05-23T04:09:53.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 565.980359ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8832024-05-23T04:09:54.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.027879306s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8842024-05-23T04:09:54.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 917.82031ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8852024-05-23T04:09:55.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 1.098049356s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8862024-05-23T04:09:55.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 831.464778ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8872024-05-23T04:09:56.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.322751915s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8882024-05-23T04:09:56.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 1.212959653s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8892024-05-23T04:09:57.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 661.283792ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8902024-05-23T04:09:58.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 773.303416ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8912024-05-23T04:09:58.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 503.31429ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8922024-05-23T04:09:58.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.38574749s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8932024-05-23T04:09:59.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 953.658541ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8942024-05-23T04:10:00.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 943.351468ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8952024-05-23T04:10:00.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.310245465s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8962024-05-23T04:10:01.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 598.031342ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8972024-05-23T04:10:01.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.132525925s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
8982024-05-23T04:10:01.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 1.192865799s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
8992024-05-23T04:10:02.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0") failed: Property not found. retry in 1.136249895s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
9002024-05-23T04:10:02.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83") failed: Property not found. retry in 611.649825ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
9012024-05-23T04:10:03.889ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_0991fc60-db92-48bd-98ab-c75e1b5f8602
9022024-05-23T04:10:03.889ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_d2b07c28-e592-41ef-a5c3-12abb0c287a0
9032024-05-23T04:10:03.889ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_c684ab4f-842e-446a-9c72-66d96c373df0
9042024-05-23T04:10:03.889ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_d88a5bfa-e8e5-4978-96bb-9cc102bbcb83
9052024-05-23T04:10:03.889ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_cockroachdb_acabd678-d607-4318-83ef-dba5de52dcaa
9062024-05-23T04:10:03.889ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9072024-05-23T04:10:03.890ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9082024-05-23T04:10:03.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 23568858 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:55479 req_id = d5bd5114-125f-497b-9f30-6cdaebd7f036 response_code = 204 uri = /omicron-zones
9092024-05-23T04:10:03.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59723
9102024-05-23T04:10:03.953ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::4]:32221 file = sled-agent/src/services.rs:3437
9112024-05-23T04:10:04.148ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3455
9122024-05-23T04:10:08.928ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3478
9132024-05-23T04:10:08.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 5004096 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:59723 req_id = 25d1b17d-640c-4647-9f3a-7902ffbef91a response_code = 204 uri = /cockroachdb
9142024-05-23T04:10:08.968ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6672c6aa-40ee-4a8b-98e3-e6a94a2240c9, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: d71ec52c-5013-463a-8d1b-f1ddff885b20, kind: Service { id: 6672c6aa-40ee-4a8b-98e3-e6a94a2240c9 }, name: Name("ntp-6672c6aa-40ee-4a8b-98e3-e6a94a2240c9"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 238])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.3.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: d2b07c28-e592-41ef-a5c3-12abb0c287a0, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0991fc60-db92-48bd-98ab-c75e1b5f8602, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External } } } }, OmicronZoneConfig { id: d88a5bfa-e8e5-4978-96bb-9cc102bbcb83, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External } } } }, OmicronZoneConfig { id: c684ab4f-842e-446a-9c72-66d96c373df0, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External } } } }, OmicronZoneConfig { id: acabd678-d607-4318-83ef-dba5de52dcaa, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External } } } }, OmicronZoneConfig { id: f9573800-1c30-4708-8269-a1bc860b0a8b, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 7bae2e19-c01b-45b3-a2b1-260f88697c91, kind: Service { id: f9573800-1c30-4708-8269-a1bc860b0a8b }, name: Name("external-dns-f9573800-1c30-4708-8269-a1bc860b0a8b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 212])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: b7d8321e-1700-42d0-afe3-6ec09f05b351, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: daf22ce3-9615-4919-8bb1-c8d0aa6f0b23, kind: Service { id: b7d8321e-1700-42d0-afe3-6ec09f05b351 }, name: Name("external-dns-b7d8321e-1700-42d0-afe3-6ec09f05b351"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 175])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 4564acd5-ab8b-4cc2-a3ff-f2ca5150f960, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: d02a8d8a-46f3-4481-ab51-ce89f99b1876, kind: Service { id: 4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 }, name: Name("nexus-4564acd5-ab8b-4cc2-a3ff-f2ca5150f960"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 108])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: df2b7432-0b0b-4a35-b8ff-ef158746030c, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: ca25937a-a517-4703-865f-b8b56e6121f2, kind: Service { id: df2b7432-0b0b-4a35-b8ff-ef158746030c }, name: Name("nexus-df2b7432-0b0b-4a35-b8ff-ef158746030c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3fa2c857-fe52-4624-9e17-989085eb0ca3, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 887842f8-32a8-41a3-a35f-525853cc566e, kind: Service { id: 3fa2c857-fe52-4624-9e17-989085eb0ca3 }, name: Name("nexus-3fa2c857-fe52-4624-9e17-989085eb0ca3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c416e609-fdb5-4fd4-b756-7e4df813bc3f, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 280bd7d5-7e9d-4201-884c-a5a0713b645f, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1d35b851-2eed-4c3b-a118-4b4b6f0d45d8, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: e4566ca7-d964-4050-881d-1343b9020621, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: fdf0dc5f-c6af-4057-a783-9f42aedfdbda, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External } } } }, OmicronZoneConfig { id: e5518ba0-1d66-4ee6-ad11-9395c9c50166, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External } } } }, OmicronZoneConfig { id: 79614ebb-af16-4a21-8afa-5201ce927afc, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External } } } }, OmicronZoneConfig { id: c48cabee-32f0-4e53-aa87-0aaf98aca5d6, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External } } } }, OmicronZoneConfig { id: 40563f3a-ed0b-4a49-a0c7-f16ce140df7e, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External } } } }, OmicronZoneConfig { id: 4c931f12-9018-4492-921b-6ad83ff16c8b, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 127f2afe-c507-4a93-ad56-3834e79f35c8 (zpool), kind: External } } } }, OmicronZoneConfig { id: e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 31801aa5-cbc2-46ad-8317-204ec0a5cef6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 13d631dc-ff99-41be-9cb8-3df6f79b69cb, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d (zpool), kind: External } } } }, OmicronZoneConfig { id: b451f59e-9d07-48e6-9b76-e6370fcdfd00, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b755abc1-d573-403a-80b5-740c5b5b87fd (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:430 sled_address = [fd00:1122:3344:101::1]:12345
9152024-05-23T04:10:08.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54905
9162024-05-23T04:10:08.968ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9172024-05-23T04:10:08.968ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 5e18fd22-8f93-470c-8e9a-dcf9298b8568, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9182024-05-23T04:10:08.990ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9192024-05-23T04:10:08.991ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 060a01a4-ea60-49b9-9e88-edf5266ddbcd, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9202024-05-23T04:10:09.013ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9212024-05-23T04:10:09.013ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 3c4a2e19-a9df-4151-9dda-0677680ad2d0, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: InternalDns }, responder: ... }
9222024-05-23T04:10:09.032ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d2b07c28-e592-41ef-a5c3-12abb0c287a0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9232024-05-23T04:10:09.032ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d2b07c28-e592-41ef-a5c3-12abb0c287a0, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9242024-05-23T04:10:09.050ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0991fc60-db92-48bd-98ab-c75e1b5f8602, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9252024-05-23T04:10:09.050ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 0991fc60-db92-48bd-98ab-c75e1b5f8602, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9262024-05-23T04:10:09.068ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d88a5bfa-e8e5-4978-96bb-9cc102bbcb83, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9272024-05-23T04:10:09.068ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d88a5bfa-e8e5-4978-96bb-9cc102bbcb83, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9282024-05-23T04:10:09.087ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c684ab4f-842e-446a-9c72-66d96c373df0, dataset_name: DatasetName { pool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9292024-05-23T04:10:09.087ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c684ab4f-842e-446a-9c72-66d96c373df0, dataset_name: DatasetName { pool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9302024-05-23T04:10:09.108ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: acabd678-d607-4318-83ef-dba5de52dcaa, dataset_name: DatasetName { pool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9312024-05-23T04:10:09.108ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: acabd678-d607-4318-83ef-dba5de52dcaa, dataset_name: DatasetName { pool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9322024-05-23T04:10:09.126ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f9573800-1c30-4708-8269-a1bc860b0a8b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9332024-05-23T04:10:09.126ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: f9573800-1c30-4708-8269-a1bc860b0a8b, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9342024-05-23T04:10:09.200ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b7d8321e-1700-42d0-afe3-6ec09f05b351, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9352024-05-23T04:10:09.200ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: b7d8321e-1700-42d0-afe3-6ec09f05b351, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9362024-05-23T04:10:09.273ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 280bd7d5-7e9d-4201-884c-a5a0713b645f, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
9372024-05-23T04:10:09.273ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 280bd7d5-7e9d-4201-884c-a5a0713b645f, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9382024-05-23T04:10:09.339ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9392024-05-23T04:10:09.340ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc, dataset_name: DatasetName { pool_name: ZpoolName { id: 8c0011d1-3f05-4d38-94bb-2f22c941a173 (zpool), kind: External }, kind: Crucible }, responder: ... }
9402024-05-23T04:10:09.406ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e5518ba0-1d66-4ee6-ad11-9395c9c50166, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9412024-05-23T04:10:09.406ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e5518ba0-1d66-4ee6-ad11-9395c9c50166, dataset_name: DatasetName { pool_name: ZpoolName { id: 6104f922-62c0-4d69-bcb4-36106df31285 (zpool), kind: External }, kind: Crucible }, responder: ... }
9422024-05-23T04:10:09.487ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 79614ebb-af16-4a21-8afa-5201ce927afc, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9432024-05-23T04:10:09.487ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 79614ebb-af16-4a21-8afa-5201ce927afc, dataset_name: DatasetName { pool_name: ZpoolName { id: c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec (zpool), kind: External }, kind: Crucible }, responder: ... }
9442024-05-23T04:10:09.567ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c48cabee-32f0-4e53-aa87-0aaf98aca5d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9452024-05-23T04:10:09.567ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c48cabee-32f0-4e53-aa87-0aaf98aca5d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 7a0ba1c9-0994-46ee-848a-8efaae776d11 (zpool), kind: External }, kind: Crucible }, responder: ... }
9462024-05-23T04:10:09.639ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 40563f3a-ed0b-4a49-a0c7-f16ce140df7e, dataset_name: DatasetName { pool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9472024-05-23T04:10:09.639ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 40563f3a-ed0b-4a49-a0c7-f16ce140df7e, dataset_name: DatasetName { pool_name: ZpoolName { id: 3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a (zpool), kind: External }, kind: Crucible }, responder: ... }
9482024-05-23T04:10:09.716ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4c931f12-9018-4492-921b-6ad83ff16c8b, dataset_name: DatasetName { pool_name: ZpoolName { id: 127f2afe-c507-4a93-ad56-3834e79f35c8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9492024-05-23T04:10:09.716ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 4c931f12-9018-4492-921b-6ad83ff16c8b, dataset_name: DatasetName { pool_name: ZpoolName { id: 127f2afe-c507-4a93-ad56-3834e79f35c8 (zpool), kind: External }, kind: Crucible }, responder: ... }
9502024-05-23T04:10:09.781ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe, dataset_name: DatasetName { pool_name: ZpoolName { id: 31801aa5-cbc2-46ad-8317-204ec0a5cef6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9512024-05-23T04:10:09.781ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe, dataset_name: DatasetName { pool_name: ZpoolName { id: 31801aa5-cbc2-46ad-8317-204ec0a5cef6 (zpool), kind: External }, kind: Crucible }, responder: ... }
9522024-05-23T04:10:09.846ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 13d631dc-ff99-41be-9cb8-3df6f79b69cb, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9532024-05-23T04:10:09.846ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 13d631dc-ff99-41be-9cb8-3df6f79b69cb, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d (zpool), kind: External }, kind: Crucible }, responder: ... }
9542024-05-23T04:10:09.907ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b451f59e-9d07-48e6-9b76-e6370fcdfd00, dataset_name: DatasetName { pool_name: ZpoolName { id: b755abc1-d573-403a-80b5-740c5b5b87fd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9552024-05-23T04:10:09.907ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: b451f59e-9d07-48e6-9b76-e6370fcdfd00, dataset_name: DatasetName { pool_name: ZpoolName { id: b755abc1-d573-403a-80b5-740c5b5b87fd (zpool), kind: External }, kind: Crucible }, responder: ... }
9562024-05-23T04:10:09.973ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9572024-05-23T04:10:09.974ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/omicron-zones.json file = common/src/ledger.rs:177
9582024-05-23T04:10:09.974ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/omicron-zones.json file = common/src/ledger.rs:177
9592024-05-23T04:10:09.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9602024-05-23T04:10:10.094ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9612024-05-23T04:10:10.158ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9622024-05-23T04:10:10.159ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9632024-05-23T04:10:10.159ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9642024-05-23T04:10:10.159ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9652024-05-23T04:10:10.159ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9662024-05-23T04:10:10.159ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9672024-05-23T04:10:10.186ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9682024-05-23T04:10:10.186ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9692024-05-23T04:10:10.186ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9702024-05-23T04:10:10.388ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9712024-05-23T04:10:10.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9722024-05-23T04:10:10.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9732024-05-23T04:10:10.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9742024-05-23T04:10:10.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9752024-05-23T04:10:10.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9762024-05-23T04:10:10.391ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9772024-05-23T04:10:10.391ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9782024-05-23T04:10:10.404ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9792024-05-23T04:10:10.405ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f file = illumos-utils/src/zone.rs:315
9802024-05-23T04:10:10.411ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e file = illumos-utils/src/zone.rs:315
9812024-05-23T04:10:10.416ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb file = illumos-utils/src/zone.rs:315
9822024-05-23T04:10:10.422ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00 file = illumos-utils/src/zone.rs:315
9832024-05-23T04:10:10.427ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b file = illumos-utils/src/zone.rs:315
9842024-05-23T04:10:10.432ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda file = illumos-utils/src/zone.rs:315
9852024-05-23T04:10:10.438ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc file = illumos-utils/src/zone.rs:315
9862024-05-23T04:10:10.443ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc file = illumos-utils/src/zone.rs:315
9872024-05-23T04:10:10.556ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38149
9882024-05-23T04:10:10.556ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 106 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38149 req_id = 2593ddce-be6c-4af0-9481-4aea57cfc2aa response_code = 200 uri = /baseboard
9892024-05-23T04:10:10.570ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f file = illumos-utils/src/zone.rs:354
9902024-05-23T04:10:10.575ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e file = illumos-utils/src/zone.rs:354
9912024-05-23T04:10:10.579ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb file = illumos-utils/src/zone.rs:354
9922024-05-23T04:10:10.584ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00 file = illumos-utils/src/zone.rs:354
9932024-05-23T04:10:10.589ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b file = illumos-utils/src/zone.rs:354
9942024-05-23T04:10:10.595ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda file = illumos-utils/src/zone.rs:354
9952024-05-23T04:10:10.600ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc file = illumos-utils/src/zone.rs:354
9962024-05-23T04:10:10.606ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc file = illumos-utils/src/zone.rs:354
9972024-05-23T04:10:10.611ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166 file = illumos-utils/src/zone.rs:315
9982024-05-23T04:10:10.617ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6 file = illumos-utils/src/zone.rs:315
9992024-05-23T04:10:10.623ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621 file = illumos-utils/src/zone.rs:315
10002024-05-23T04:10:10.629ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe file = illumos-utils/src/zone.rs:315
10012024-05-23T04:10:10.636ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8 file = illumos-utils/src/zone.rs:315
10022024-05-23T04:10:10.642ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f file = illumos-utils/src/zone.rs:315
10032024-05-23T04:10:10.650ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166 file = illumos-utils/src/zone.rs:354
10042024-05-23T04:10:10.657ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6 file = illumos-utils/src/zone.rs:354
10052024-05-23T04:10:10.663ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621 file = illumos-utils/src/zone.rs:354
10062024-05-23T04:10:10.669ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe file = illumos-utils/src/zone.rs:354
10072024-05-23T04:10:10.677ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8 file = illumos-utils/src/zone.rs:354
10082024-05-23T04:10:10.685ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f file = illumos-utils/src/zone.rs:354
10092024-05-23T04:10:10.784ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10102024-05-23T04:10:10.856ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10112024-05-23T04:10:10.943ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10122024-05-23T04:10:11.006ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10132024-05-23T04:10:11.065ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10142024-05-23T04:10:11.068ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10152024-05-23T04:10:11.068ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10162024-05-23T04:10:11.165ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 251, 74]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte1" } }
10172024-05-23T04:10:11.165ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10182024-05-23T04:10:11.170ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10192024-05-23T04:10:11.170ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10202024-05-23T04:10:11.283ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte2", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 132, 182]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte2" } }
10212024-05-23T04:10:11.283ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10222024-05-23T04:10:11.286ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10232024-05-23T04:10:11.286ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10242024-05-23T04:10:11.391ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 254, 212]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte3" } }
10252024-05-23T04:10:11.391ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10262024-05-23T04:10:11.398ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10272024-05-23T04:10:11.398ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10282024-05-23T04:10:11.488ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 220, 175]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte4" } }
10292024-05-23T04:10:11.488ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10302024-05-23T04:10:11.493ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10312024-05-23T04:10:11.494ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10322024-05-23T04:10:11.586ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 149, 108]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte5" } }
10332024-05-23T04:10:11.586ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10342024-05-23T04:10:11.588ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10352024-05-23T04:10:11.588ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10362024-05-23T04:10:11.588ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10372024-05-23T04:10:11.588ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10382024-05-23T04:10:11.588ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10392024-05-23T04:10:11.588ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10402024-05-23T04:10:11.589ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10412024-05-23T04:10:11.589ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10422024-05-23T04:10:11.590ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10432024-05-23T04:10:11.593ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10442024-05-23T04:10:11.593ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10452024-05-23T04:10:11.593ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10462024-05-23T04:10:11.593ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10472024-05-23T04:10:11.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10482024-05-23T04:10:11.596ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10492024-05-23T04:10:11.601ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10502024-05-23T04:10:11.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10512024-05-23T04:10:11.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10522024-05-23T04:10:11.642ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10532024-05-23T04:10:11.677ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10542024-05-23T04:10:11.748ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3 file = illumos-utils/src/zone.rs:315
10552024-05-23T04:10:11.793ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b file = illumos-utils/src/zone.rs:315
10562024-05-23T04:10:11.801ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351 file = illumos-utils/src/zone.rs:315
10572024-05-23T04:10:11.809ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 file = illumos-utils/src/zone.rs:315
10582024-05-23T04:10:11.816ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3 file = illumos-utils/src/zone.rs:354
10592024-05-23T04:10:11.825ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c file = illumos-utils/src/zone.rs:315
10602024-05-23T04:10:11.834ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b file = illumos-utils/src/zone.rs:354
10612024-05-23T04:10:11.841ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351 file = illumos-utils/src/zone.rs:354
10622024-05-23T04:10:11.848ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 file = illumos-utils/src/zone.rs:354
10632024-05-23T04:10:11.860ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c file = illumos-utils/src/zone.rs:354
10642024-05-23T04:10:12.930ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10652024-05-23T04:10:12.931ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
10662024-05-23T04:10:12.979ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="84f418eb-ce42-42a6-ad3e-e76f0576ef20"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10672024-05-23T04:10:12.979ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
10682024-05-23T04:10:13.034ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_b755abc1-d573-403a-80b5-740c5b5b87fd/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="fc8acf0e-ca86-4d22-9c16-96d43810d620"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10692024-05-23T04:10:13.034ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
10702024-05-23T04:10:13.057ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="1c18ea93-8152-4dcc-b224-8a139eebb2e8"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10712024-05-23T04:10:13.057ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="63cc5bec-9bb2-40ee-ae53-8af4d6b93d9e"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10722024-05-23T04:10:13.057ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
10732024-05-23T04:10:13.065ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
10742024-05-23T04:10:13.118ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_6104f922-62c0-4d69-bcb4-36106df31285/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="ad913ce7-8597-449f-a5c7-aec449a76aea"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10752024-05-23T04:10:13.123ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
10762024-05-23T04:10:13.156ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10772024-05-23T04:10:13.157ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
10782024-05-23T04:10:13.195ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_127f2afe-c507-4a93-ad56-3834e79f35c8/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="95228679-0dff-4bcd-9606-62a71272e9f5"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10792024-05-23T04:10:13.216ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_7a0ba1c9-0994-46ee-848a-8efaae776d11/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="96bd6a1b-2217-4d92-a086-31460e4ea2cd"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10802024-05-23T04:10:13.216ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
10812024-05-23T04:10:13.219ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
10822024-05-23T04:10:13.499ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_8c0011d1-3f05-4d38-94bb-2f22c941a173/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="ab6c4840-6255-47bf-b48c-d7c8694760b8"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10832024-05-23T04:10:13.500ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
10842024-05-23T04:10:13.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 56.750725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
10852024-05-23T04:10:13.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 27.037728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
10862024-05-23T04:10:13.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 58.714869ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
10872024-05-23T04:10:13.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 29.620532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
10882024-05-23T04:10:13.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 40.115635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
10892024-05-23T04:10:13.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 124.555307ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
10902024-05-23T04:10:13.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 141.386766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
10912024-05-23T04:10:13.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 106.949181ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
10922024-05-23T04:10:13.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 89.264715ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
10932024-05-23T04:10:13.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 196.577851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
10942024-05-23T04:10:14.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 73.400961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
10952024-05-23T04:10:14.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 90.221895ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
10962024-05-23T04:10:14.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 48.709788ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
10972024-05-23T04:10:14.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 32.777069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
10982024-05-23T04:10:14.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 265.682509ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
10992024-05-23T04:10:14.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 74.973204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
11002024-05-23T04:10:14.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 124.135761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
11012024-05-23T04:10:14.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 270.665876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
11022024-05-23T04:10:14.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 490.412211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
11032024-05-23T04:10:14.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 79.366449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
11042024-05-23T04:10:14.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 42.090738ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
11052024-05-23T04:10:14.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 240.593624ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
11062024-05-23T04:10:14.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 82.076173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
11072024-05-23T04:10:14.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 104.39976ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
11082024-05-23T04:10:14.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 473.506041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
11092024-05-23T04:10:14.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 83.572299ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
11102024-05-23T04:10:14.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 504.246661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
11112024-05-23T04:10:14.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 285.898688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
11122024-05-23T04:10:14.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 96.209616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
11132024-05-23T04:10:14.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 190.04871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
11142024-05-23T04:10:14.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 110.344033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
11152024-05-23T04:10:14.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 365.518097ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
11162024-05-23T04:10:14.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 197.758512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
11172024-05-23T04:10:14.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 126.698853ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
11182024-05-23T04:10:14.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 472.740027ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
11192024-05-23T04:10:14.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 375.540072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
11202024-05-23T04:10:14.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 416.034358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
11212024-05-23T04:10:14.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 233.960384ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
11222024-05-23T04:10:15.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 324.806059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
11232024-05-23T04:10:15.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 543.085352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
11242024-05-23T04:10:15.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 294.451617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
11252024-05-23T04:10:15.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 811.976656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
11262024-05-23T04:10:15.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 569.753022ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
11272024-05-23T04:10:15.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.141637965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
11282024-05-23T04:10:15.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 517.727879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
11292024-05-23T04:10:15.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 732.4271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
11302024-05-23T04:10:15.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 646.328979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
11312024-05-23T04:10:15.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 988.674857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
11322024-05-23T04:10:15.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 1.193229582s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
11332024-05-23T04:10:15.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 907.087402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
11342024-05-23T04:10:15.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 1.123924472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
11352024-05-23T04:10:15.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.023238435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
11362024-05-23T04:10:15.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.301146179s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
11372024-05-23T04:10:16.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 1.464734183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
11382024-05-23T04:10:16.001ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11392024-05-23T04:10:16.002ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
11402024-05-23T04:10:16.013ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_31801aa5-cbc2-46ad-8317-204ec0a5cef6/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="c3a9b915-0944-42ce-8571-ce91cf098577"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11412024-05-23T04:10:16.014ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
11422024-05-23T04:10:16.130ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="c416e609-fdb5-4fd4-b756-7e4df813bc3f"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11432024-05-23T04:10:16.131ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
11442024-05-23T04:10:16.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 1.158928518s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
11452024-05-23T04:10:16.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 1.094747385s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
11462024-05-23T04:10:16.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 63.815831ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
11472024-05-23T04:10:16.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 64.037988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
11482024-05-23T04:10:16.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 91.013437ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
11492024-05-23T04:10:16.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 110.248056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
11502024-05-23T04:10:16.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 57.016142ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
11512024-05-23T04:10:16.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 952.623688ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
11522024-05-23T04:10:16.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 248.303044ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
11532024-05-23T04:10:16.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 252.230827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
11542024-05-23T04:10:16.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.233421257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
11552024-05-23T04:10:16.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 66.926747ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
11562024-05-23T04:10:16.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 525.947679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
11572024-05-23T04:10:16.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 263.154712ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
11582024-05-23T04:10:16.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 459.414589ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
11592024-05-23T04:10:16.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 931.682983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
11602024-05-23T04:10:16.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 365.029911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
11612024-05-23T04:10:16.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 1.081217872s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
11622024-05-23T04:10:16.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.064234449s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
11632024-05-23T04:10:16.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 262.647771ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
11642024-05-23T04:10:17.056ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11652024-05-23T04:10:17.056ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
11662024-05-23T04:10:17.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 1.215523694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
11672024-05-23T04:10:17.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 655.43502ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
11682024-05-23T04:10:17.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 1.191827657s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
11692024-05-23T04:10:17.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 402.43743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
11702024-05-23T04:10:17.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 568.18405ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
11712024-05-23T04:10:17.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 1.209648243s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
11722024-05-23T04:10:17.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 627.929084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
11732024-05-23T04:10:17.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 62.640282ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
11742024-05-23T04:10:17.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 119.624552ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
11752024-05-23T04:10:17.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.139839138s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
11762024-05-23T04:10:17.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 503.576111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
11772024-05-23T04:10:17.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 146.205783ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
11782024-05-23T04:10:17.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 953.301934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
11792024-05-23T04:10:17.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 622.513435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
11802024-05-23T04:10:17.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 489.389299ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
11812024-05-23T04:10:17.729ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11822024-05-23T04:10:17.730ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
11832024-05-23T04:10:17.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 822.779148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
11842024-05-23T04:10:17.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 1.319778135s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
11852024-05-23T04:10:17.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 772.207018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
11862024-05-23T04:10:17.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 780.64497ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
11872024-05-23T04:10:17.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.138585017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
11882024-05-23T04:10:17.896ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11892024-05-23T04:10:17.896ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
11902024-05-23T04:10:17.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 53.833397ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
11912024-05-23T04:10:17.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 1.166401006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
11922024-05-23T04:10:17.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 1.497269893s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
11932024-05-23T04:10:18.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 140.982275ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
11942024-05-23T04:10:18.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 43.972138ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
11952024-05-23T04:10:18.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 155.285317ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
11962024-05-23T04:10:18.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 72.031258ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
11972024-05-23T04:10:18.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 871.921771ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
11982024-05-23T04:10:18.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 260.940017ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
11992024-05-23T04:10:18.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 1.005134491s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
12002024-05-23T04:10:18.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 337.614572ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
12012024-05-23T04:10:18.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 1.25822692s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
12022024-05-23T04:10:18.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 1.428827725s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
12032024-05-23T04:10:18.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 638.640382ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
12042024-05-23T04:10:18.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 419.563973ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
12052024-05-23T04:10:18.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.043764953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
12062024-05-23T04:10:18.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 696.201387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
12072024-05-23T04:10:18.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.133333371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
12082024-05-23T04:10:18.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.47731278s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
12092024-05-23T04:10:18.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 1.158147572s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
12102024-05-23T04:10:18.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 551.550175ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
12112024-05-23T04:10:19.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.11331027s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
12122024-05-23T04:10:19.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.443370205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
12132024-05-23T04:10:19.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 532.541796ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
12142024-05-23T04:10:19.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 529.453533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
12152024-05-23T04:10:19.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 759.458281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
12162024-05-23T04:10:19.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 723.374595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
12172024-05-23T04:10:19.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 567.619353ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
12182024-05-23T04:10:19.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.126192939s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
12192024-05-23T04:10:19.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 743.835211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
12202024-05-23T04:10:19.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 687.250915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
12212024-05-23T04:10:19.606ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12222024-05-23T04:10:19.607ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
12232024-05-23T04:10:19.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.496921322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
12242024-05-23T04:10:19.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 1.273232897s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
12252024-05-23T04:10:19.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 1.2227986s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
12262024-05-23T04:10:19.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 929.678425ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
12272024-05-23T04:10:19.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.143421961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
12282024-05-23T04:10:19.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 1.353582001s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
12292024-05-23T04:10:19.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 1.171258288s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
12302024-05-23T04:10:19.936ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 808.344184ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
12312024-05-23T04:10:19.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 974.438801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
12322024-05-23T04:10:19.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 62.151283ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
12332024-05-23T04:10:19.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 1.256299472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
12342024-05-23T04:10:20.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 99.919494ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
12352024-05-23T04:10:20.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 850.697402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
12362024-05-23T04:10:20.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 121.376076ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
12372024-05-23T04:10:20.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.281643239s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
12382024-05-23T04:10:20.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 709.591784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
12392024-05-23T04:10:20.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 1.112948094s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
12402024-05-23T04:10:20.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 352.284874ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
12412024-05-23T04:10:20.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.438089557s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
12422024-05-23T04:10:20.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 917.120872ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
12432024-05-23T04:10:20.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 1.054738953s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
12442024-05-23T04:10:20.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 519.59785ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
12452024-05-23T04:10:20.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 1.098449198s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
12462024-05-23T04:10:20.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 948.604667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
12472024-05-23T04:10:20.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 829.900329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
12482024-05-23T04:10:20.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.275239376s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
12492024-05-23T04:10:20.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 1.332578557s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
12502024-05-23T04:10:21.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 1.327632367s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
12512024-05-23T04:10:21.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.303159246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
12522024-05-23T04:10:21.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 1.365314188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
12532024-05-23T04:10:21.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 551.273654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
12542024-05-23T04:10:21.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 1.365219541s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
12552024-05-23T04:10:21.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 1.315560654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
12562024-05-23T04:10:21.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 643.163066ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
12572024-05-23T04:10:21.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 843.384256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
12582024-05-23T04:10:21.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.157913371s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
12592024-05-23T04:10:21.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.338582445s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
12602024-05-23T04:10:21.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 1.010396904s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
12612024-05-23T04:10:21.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 729.532195ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
12622024-05-23T04:10:21.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 1.488307605s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
12632024-05-23T04:10:21.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 964.984143ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
12642024-05-23T04:10:21.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 880.782821ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
12652024-05-23T04:10:21.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 1.192032192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
12662024-05-23T04:10:21.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 823.479581ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
12672024-05-23T04:10:22.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 1.380190072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
12682024-05-23T04:10:22.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.316089618s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
12692024-05-23T04:10:22.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 1.048685588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
12702024-05-23T04:10:22.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 770.614802ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
12712024-05-23T04:10:22.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 950.247642ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
12722024-05-23T04:10:22.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 1.068537307s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
12732024-05-23T04:10:22.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 735.052007ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
12742024-05-23T04:10:22.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 651.604196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
12752024-05-23T04:10:22.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 1.420240971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
12762024-05-23T04:10:22.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 726.988258ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
12772024-05-23T04:10:22.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 926.689059ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
12782024-05-23T04:10:22.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 534.401995ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
12792024-05-23T04:10:22.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.390086083s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
12802024-05-23T04:10:22.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 954.751086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
12812024-05-23T04:10:22.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 943.495098ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
12822024-05-23T04:10:22.971ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12832024-05-23T04:10:22.971ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
12842024-05-23T04:10:23.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.066286167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
12852024-05-23T04:10:23.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 1.118923914s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
12862024-05-23T04:10:23.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.171431231s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
12872024-05-23T04:10:23.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 549.163196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
12882024-05-23T04:10:23.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 47.33876ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
12892024-05-23T04:10:23.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 731.191231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
12902024-05-23T04:10:23.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 576.070008ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
12912024-05-23T04:10:23.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 145.937289ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
12922024-05-23T04:10:23.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 1.297236313s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
12932024-05-23T04:10:23.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 762.477216ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
12942024-05-23T04:10:23.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 903.965488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
12952024-05-23T04:10:23.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 135.199592ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
12962024-05-23T04:10:23.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 1.257323451s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
12972024-05-23T04:10:23.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.39623029s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
12982024-05-23T04:10:23.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 1.440147699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
12992024-05-23T04:10:23.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 472.1292ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
13002024-05-23T04:10:23.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 1.054693862s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
13012024-05-23T04:10:23.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.237233773s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
13022024-05-23T04:10:23.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 1.481089694s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
13032024-05-23T04:10:23.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 768.328589ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
13042024-05-23T04:10:23.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 895.542181ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
13052024-05-23T04:10:24.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 601.342083ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
13062024-05-23T04:10:24.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 1.388757435s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
13072024-05-23T04:10:24.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 530.724086ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
13082024-05-23T04:10:24.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 866.558716ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
13092024-05-23T04:10:24.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.065071286s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
13102024-05-23T04:10:24.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.122940046s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
13112024-05-23T04:10:24.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 962.463966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
13122024-05-23T04:10:24.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 744.242128ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
13132024-05-23T04:10:24.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 871.25223ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
13142024-05-23T04:10:24.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 1.255023188s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
13152024-05-23T04:10:24.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 1.458764327s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
13162024-05-23T04:10:24.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 684.729843ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
13172024-05-23T04:10:24.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 694.80392ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
13182024-05-23T04:10:24.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 748.644018ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
13192024-05-23T04:10:24.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 689.062722ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
13202024-05-23T04:10:24.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 800.421267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
13212024-05-23T04:10:24.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.43618636s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
13222024-05-23T04:10:25.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.348976599s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
13232024-05-23T04:10:25.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.24549468s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
13242024-05-23T04:10:25.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 501.050524ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
13252024-05-23T04:10:25.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 716.386184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
13262024-05-23T04:10:25.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 1.238661006s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
13272024-05-23T04:10:25.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.461507131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
13282024-05-23T04:10:25.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.034909163s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
13292024-05-23T04:10:25.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 1.24763329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
13302024-05-23T04:10:25.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 764.886252ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
13312024-05-23T04:10:25.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 559.225332ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
13322024-05-23T04:10:25.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 1.390389767s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
13332024-05-23T04:10:25.393ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13342024-05-23T04:10:25.393ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
13352024-05-23T04:10:25.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 764.104579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
13362024-05-23T04:10:25.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 1.254170499s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
13372024-05-23T04:10:25.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 865.801103ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
13382024-05-23T04:10:25.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 1.28960226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
13392024-05-23T04:10:25.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 36.696986ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
13402024-05-23T04:10:25.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 1.19882165s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
13412024-05-23T04:10:25.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 80.08298ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
13422024-05-23T04:10:25.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 183.021178ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
13432024-05-23T04:10:25.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 869.353284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
13442024-05-23T04:10:25.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 1.428772737s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
13452024-05-23T04:10:25.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 940.24848ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
13462024-05-23T04:10:25.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 285.971939ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
13472024-05-23T04:10:26.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 922.595823ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
13482024-05-23T04:10:26.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 1.468172188s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
13492024-05-23T04:10:26.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 1.307781416s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
13502024-05-23T04:10:26.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 1.19781988s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
13512024-05-23T04:10:26.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.162705608s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
13522024-05-23T04:10:26.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.388405338s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
13532024-05-23T04:10:26.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 1.035512464s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
13542024-05-23T04:10:26.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.441223291s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
13552024-05-23T04:10:26.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.210333167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
13562024-05-23T04:10:26.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 953.609531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
13572024-05-23T04:10:26.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 935.005217ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
13582024-05-23T04:10:26.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 1.116092456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
13592024-05-23T04:10:26.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 502.550107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
13602024-05-23T04:10:26.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 974.370296ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
13612024-05-23T04:10:26.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 1.030586685s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
13622024-05-23T04:10:26.802ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 39.489952098s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
13632024-05-23T04:10:26.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 1.055848751s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
13642024-05-23T04:10:26.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.178398672s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
13652024-05-23T04:10:26.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 1.278426584s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
13662024-05-23T04:10:27.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 1.306392961s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
13672024-05-23T04:10:27.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.152323805s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
13682024-05-23T04:10:27.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 549.380044ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
13692024-05-23T04:10:27.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 815.924641ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
13702024-05-23T04:10:27.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 940.256617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
13712024-05-23T04:10:27.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 627.346262ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
13722024-05-23T04:10:27.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 663.135288ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
13732024-05-23T04:10:27.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 681.706385ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
13742024-05-23T04:10:27.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 687.500335ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
13752024-05-23T04:10:27.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 839.097595ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
13762024-05-23T04:10:27.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 662.069568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
13772024-05-23T04:10:27.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 623.792374ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
13782024-05-23T04:10:27.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.385707105s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
13792024-05-23T04:10:27.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 800.890298ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
13802024-05-23T04:10:27.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 845.199215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
13812024-05-23T04:10:27.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 1.31248678s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
13822024-05-23T04:10:27.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 609.319772ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
13832024-05-23T04:10:27.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 1.38872933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
13842024-05-23T04:10:28.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 739.26461ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
13852024-05-23T04:10:28.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 587.532525ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
13862024-05-23T04:10:28.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 770.751935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
13872024-05-23T04:10:28.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 1.194758756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
13882024-05-23T04:10:28.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.164900266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
13892024-05-23T04:10:28.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 1.361551678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
13902024-05-23T04:10:28.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 983.392904ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
13912024-05-23T04:10:28.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.041568419s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
13922024-05-23T04:10:28.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 707.36735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
13932024-05-23T04:10:28.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 806.394099ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
13942024-05-23T04:10:28.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 879.919877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
13952024-05-23T04:10:28.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 582.321527ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
13962024-05-23T04:10:28.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 874.500514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
13972024-05-23T04:10:28.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.430671061s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
13982024-05-23T04:10:28.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 551.856963ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
13992024-05-23T04:10:28.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 1.352710514s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
14002024-05-23T04:10:28.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 948.657309ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
14012024-05-23T04:10:28.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.207389597s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
14022024-05-23T04:10:28.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 958.866118ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
14032024-05-23T04:10:29.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 615.645909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
14042024-05-23T04:10:29.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 729.55866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
14052024-05-23T04:10:29.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.455256077s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
14062024-05-23T04:10:29.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 936.707028ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
14072024-05-23T04:10:29.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 585.245896ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
14082024-05-23T04:10:29.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 1.05369577s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
14092024-05-23T04:10:29.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 800.457334ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
14102024-05-23T04:10:29.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 1.350466192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
14112024-05-23T04:10:29.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 828.865619ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
14122024-05-23T04:10:29.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 1.129998393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
14132024-05-23T04:10:29.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 514.80413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
14142024-05-23T04:10:29.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 1.432511091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
14152024-05-23T04:10:29.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.454449082s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
14162024-05-23T04:10:29.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 614.244782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
14172024-05-23T04:10:29.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 503.285585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
14182024-05-23T04:10:29.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 899.98033ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
14192024-05-23T04:10:29.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 704.237478ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
14202024-05-23T04:10:29.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 921.965897ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
14212024-05-23T04:10:29.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.248718113s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
14222024-05-23T04:10:29.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 813.120512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
14232024-05-23T04:10:29.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.074846841s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
14242024-05-23T04:10:30.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.20528888s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
14252024-05-23T04:10:30.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 661.531109ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
14262024-05-23T04:10:30.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 630.072431ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
14272024-05-23T04:10:30.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 1.429940916s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
14282024-05-23T04:10:30.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 725.100136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
14292024-05-23T04:10:30.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 867.351199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
14302024-05-23T04:10:30.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 1.028151621s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
14312024-05-23T04:10:30.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 1.011954482s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
14322024-05-23T04:10:30.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 832.26574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
14332024-05-23T04:10:30.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 1.099946426s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
14342024-05-23T04:10:30.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 523.846049ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
14352024-05-23T04:10:30.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 645.358173ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
14362024-05-23T04:10:30.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 746.094041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
14372024-05-23T04:10:30.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 542.92939ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
14382024-05-23T04:10:30.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 1.404274482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
14392024-05-23T04:10:30.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 1.406170929s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
14402024-05-23T04:10:30.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 1.034568144s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
14412024-05-23T04:10:30.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 804.495464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
14422024-05-23T04:10:30.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.168630241s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
14432024-05-23T04:10:30.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.247235951s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
14442024-05-23T04:10:31.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 631.698142ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
14452024-05-23T04:10:31.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 1.293011642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
14462024-05-23T04:10:31.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 745.216627ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
14472024-05-23T04:10:31.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.213901257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
14482024-05-23T04:10:31.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.48047856s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
14492024-05-23T04:10:31.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 713.8186ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
14502024-05-23T04:10:31.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 1.364297011s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
14512024-05-23T04:10:31.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 866.55813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
14522024-05-23T04:10:31.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 1.232409023s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
14532024-05-23T04:10:31.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 1.394955571s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
14542024-05-23T04:10:31.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 899.50179ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
14552024-05-23T04:10:31.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 780.482844ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
14562024-05-23T04:10:31.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 687.360727ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
14572024-05-23T04:10:31.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 860.027504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
14582024-05-23T04:10:31.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 899.42412ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
14592024-05-23T04:10:31.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 731.40333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
14602024-05-23T04:10:31.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 1.403990264s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
14612024-05-23T04:10:32.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 736.92148ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
14622024-05-23T04:10:32.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 621.61009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
14632024-05-23T04:10:32.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 1.380030555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
14642024-05-23T04:10:32.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.323136417s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
14652024-05-23T04:10:32.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 664.503713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
14662024-05-23T04:10:32.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 1.233724393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
14672024-05-23T04:10:32.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 900.864696ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
14682024-05-23T04:10:32.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 726.091086ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
14692024-05-23T04:10:32.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 1.322373335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
14702024-05-23T04:10:32.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 834.5979ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
14712024-05-23T04:10:32.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 791.41707ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
14722024-05-23T04:10:32.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 780.659658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
14732024-05-23T04:10:32.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 966.529984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
14742024-05-23T04:10:32.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 1.189789386s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
14752024-05-23T04:10:32.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.224335996s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
14762024-05-23T04:10:32.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 685.914455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
14772024-05-23T04:10:32.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.313428183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
14782024-05-23T04:10:32.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 1.447487952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
14792024-05-23T04:10:32.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.245433985s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
14802024-05-23T04:10:32.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 963.092719ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
14812024-05-23T04:10:32.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 1.373247795s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
14822024-05-23T04:10:33.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166") failed: Property not found. retry in 1.163296482s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
14832024-05-23T04:10:33.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8") failed: Property not found. retry in 1.30599369s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
14842024-05-23T04:10:33.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f") failed: Property not found. retry in 1.03633899s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
14852024-05-23T04:10:33.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 851.9696ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
14862024-05-23T04:10:33.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 769.884323ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
14872024-05-23T04:10:33.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 791.917577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
14882024-05-23T04:10:33.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00") failed: Property not found. retry in 986.539291ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
14892024-05-23T04:10:33.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 763.285547ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
14902024-05-23T04:10:33.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 782.0453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
14912024-05-23T04:10:33.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 591.603251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
14922024-05-23T04:10:33.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621") failed: Property not found. retry in 632.572236ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
14932024-05-23T04:10:33.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe") failed: Property not found. retry in 610.078211ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
14942024-05-23T04:10:33.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 891.193321ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
14952024-05-23T04:10:33.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 674.992532ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
14962024-05-23T04:10:33.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.134388717s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
14972024-05-23T04:10:34.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f") failed: Property not found. retry in 1.483439539s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
14982024-05-23T04:10:34.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb") failed: Property not found. retry in 1.378102151s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
14992024-05-23T04:10:34.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c") failed: Property not found. retry in 1.058562979s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
15002024-05-23T04:10:34.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351") failed: Property not found. retry in 863.832607ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
15012024-05-23T04:10:34.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda") failed: Property not found. retry in 587.416675ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
15022024-05-23T04:10:34.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b") failed: Property not found. retry in 1.451844952s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
15032024-05-23T04:10:34.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 799.956087ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
15042024-05-23T04:10:34.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6") failed: Property not found. retry in 1.417489245s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
15052024-05-23T04:10:34.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e") failed: Property not found. retry in 551.125241ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
15062024-05-23T04:10:34.311ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc") failed: Property not found. retry in 1.064502942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
15072024-05-23T04:10:34.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960") failed: Property not found. retry in 924.991097ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
15082024-05-23T04:10:34.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b") failed: Property not found. retry in 675.892959ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
15092024-05-23T04:10:34.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3") failed: Property not found. retry in 1.452016844s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
15102024-05-23T04:10:35.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc") failed: Property not found. retry in 775.644614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
15112024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_external_dns_b7d8321e-1700-42d0-afe3-6ec09f05b351
15122024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_clickhouse_280bd7d5-7e9d-4201-884c-a5a0713b645f
15132024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_40563f3a-ed0b-4a49-a0c7-f16ce140df7e
15142024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_13d631dc-ff99-41be-9cb8-3df6f79b69cb
15152024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_b451f59e-9d07-48e6-9b76-e6370fcdfd00
15162024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_4c931f12-9018-4492-921b-6ad83ff16c8b
15172024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_4564acd5-ab8b-4cc2-a3ff-f2ca5150f960
15182024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_fdf0dc5f-c6af-4057-a783-9f42aedfdbda
15192024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_a97f44b4-2d0e-4c2a-a1a4-3a131ee3d0bc
15202024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_79614ebb-af16-4a21-8afa-5201ce927afc
15212024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_e5518ba0-1d66-4ee6-ad11-9395c9c50166
15222024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_c48cabee-32f0-4e53-aa87-0aaf98aca5d6
15232024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_e4566ca7-d964-4050-881d-1343b9020621
15242024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_e7c9f242-dfcc-4bd5-b092-dd2aa6ddb8fe
15252024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_crucible_pantry_1d35b851-2eed-4c3b-a118-4b4b6f0d45d8
15262024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_3fa2c857-fe52-4624-9e17-989085eb0ca3
15272024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_oximeter_c416e609-fdb5-4fd4-b756-7e4df813bc3f
15282024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_nexus_df2b7432-0b0b-4a35-b8ff-ef158746030c
15292024-05-23T04:10:36.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3026 zone = oxz_external_dns_f9573800-1c30-4708-8269-a1bc860b0a8b
15302024-05-23T04:10:36.557ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15312024-05-23T04:10:36.564ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15322024-05-23T04:10:36.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 27607848 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54905 req_id = 74aa54bd-d9d7-40b2-880a-314f87246d3c response_code = 204 uri = /omicron-zones
15332024-05-23T04:10:36.585ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1236
15342024-05-23T04:10:36.585ZINFOSledAgent (RSS): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15352024-05-23T04:10:36.591ZINFOSledAgent (RSS): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
15362024-05-23T04:10:36.602ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:680
15372024-05-23T04:10:36.612ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:693
15382024-05-23T04:10:36.718ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV1 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV1 { addresses: [ V4( Ipv4Network { addr: 10.151.2.174, prefix: 24, }, ), ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Network { addr: 0.0.0.0, prefix: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, } file = sled-agent/src/rack_setup/service.rs:817
15392024-05-23T04:10:37.141ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15402024-05-23T04:10:37.283ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15412024-05-23T04:10:37.444ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15422024-05-23T04:10:37.528ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15432024-05-23T04:10:37.700ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15442024-05-23T04:10:37.806ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15452024-05-23T04:10:37.964ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15462024-05-23T04:10:38.262ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15472024-05-23T04:10:38.628ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15482024-05-23T04:10:39.200ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15492024-05-23T04:10:39.730ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15502024-05-23T04:10:40.420ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15512024-05-23T04:10:40.633ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39188
15522024-05-23T04:10:40.634ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 219 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39188 req_id = 506f4417-cbf5-4e96-a907-942b7141550e response_code = 200 uri = /baseboard
15532024-05-23T04:10:40.973ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15542024-05-23T04:10:42.182ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15552024-05-23T04:10:42.261ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
15562024-05-23T04:10:42.836ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15572024-05-23T04:10:43.266ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
15582024-05-23T04:10:43.281ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
15592024-05-23T04:10:44.269ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
15602024-05-23T04:10:44.564ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15612024-05-23T04:10:44.940ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/nexus.rs:619 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
15622024-05-23T04:10:45.273ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
15632024-05-23T04:10:45.932ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/0abe5f02-86be-4633-bc9c-dd5a3f81bd6d/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:879
15642024-05-23T04:10:46.277ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/dc42437e-f158-48dc-b8b5-096274c6457c): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/probe_manager.rs:169 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
15652024-05-23T04:10:48.247ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a53f07ab-9b18-4fe7-a155-ca79a79c342e", "content-length": "173", "date": "Thu, 23 May 2024 04:10:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"dc42437e-f158-48dc-b8b5-096274c6457c\"", request_id: "a53f07ab-9b18-4fe7-a155-ca79a79c342e" } file = sled-agent/src/rack_setup/service.rs:879
15662024-05-23T04:10:49.016ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
15672024-05-23T04:10:49.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48470
15682024-05-23T04:10:49.178ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15692024-05-23T04:10:49.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 89960 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48470 req_id = f8b0fb47-7226-4bc3-82ba-e50d64c96f06 response_code = 200 uri = /inventory
15702024-05-23T04:10:49.263ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15712024-05-23T04:10:49.263ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/omicron-zones.json file = common/src/ledger.rs:177
15722024-05-23T04:10:49.264ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/omicron-zones.json file = common/src/ledger.rs:177
15732024-05-23T04:10:49.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48470 req_id = 1f4c7492-e58b-4edd-940c-8a6feb07398f response_code = 200 uri = /omicron-zones
15742024-05-23T04:10:51.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47866
15752024-05-23T04:10:51.487ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bae2e19-c01b-45b3-a2b1-260f88697c91, kind: Service { id: f9573800-1c30-4708-8269-a1bc860b0a8b }, name: Name("external-dns-f9573800-1c30-4708-8269-a1bc860b0a8b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 212])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: daf22ce3-9615-4919-8bb1-c8d0aa6f0b23, kind: Service { id: b7d8321e-1700-42d0-afe3-6ec09f05b351 }, name: Name("external-dns-b7d8321e-1700-42d0-afe3-6ec09f05b351"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 175])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 887842f8-32a8-41a3-a35f-525853cc566e, kind: Service { id: 3fa2c857-fe52-4624-9e17-989085eb0ca3 }, name: Name("nexus-3fa2c857-fe52-4624-9e17-989085eb0ca3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ca25937a-a517-4703-865f-b8b56e6121f2, kind: Service { id: df2b7432-0b0b-4a35-b8ff-ef158746030c }, name: Name("nexus-df2b7432-0b0b-4a35-b8ff-ef158746030c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d02a8d8a-46f3-4481-ab51-ce89f99b1876, kind: Service { id: 4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 }, name: Name("nexus-4564acd5-ab8b-4cc2-a3ff-f2ca5150f960"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 108])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15762024-05-23T04:10:51.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15772024-05-23T04:10:51.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15782024-05-23T04:10:51.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15792024-05-23T04:10:51.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15802024-05-23T04:10:51.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
15812024-05-23T04:10:51.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15822024-05-23T04:10:51.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 2674 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47866 req_id = 5ba29794-9483-4822-b0f3-ea0f60d7ebd8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15832024-05-23T04:10:51.490ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:889
15842024-05-23T04:10:51.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48727
15852024-05-23T04:10:51.792ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15862024-05-23T04:10:51.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 82971 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48727 req_id = 604a3519-0708-4f30-b25d-1bdaa45d6b62 response_code = 200 uri = /inventory
15872024-05-23T04:10:51.875ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
15882024-05-23T04:10:51.875ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/config/omicron-zones.json file = common/src/ledger.rs:177
15892024-05-23T04:10:51.876ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/config/omicron-zones.json file = common/src/ledger.rs:177
15902024-05-23T04:10:51.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1855 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48727 req_id = 6dd952d0-ebeb-4d6e-a0cf-8890475b03d4 response_code = 200 uri = /omicron-zones
15912024-05-23T04:10:52.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34142
15922024-05-23T04:10:52.719ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bae2e19-c01b-45b3-a2b1-260f88697c91, kind: Service { id: f9573800-1c30-4708-8269-a1bc860b0a8b }, name: Name("external-dns-f9573800-1c30-4708-8269-a1bc860b0a8b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 212])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: daf22ce3-9615-4919-8bb1-c8d0aa6f0b23, kind: Service { id: b7d8321e-1700-42d0-afe3-6ec09f05b351 }, name: Name("external-dns-b7d8321e-1700-42d0-afe3-6ec09f05b351"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 175])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 887842f8-32a8-41a3-a35f-525853cc566e, kind: Service { id: 3fa2c857-fe52-4624-9e17-989085eb0ca3 }, name: Name("nexus-3fa2c857-fe52-4624-9e17-989085eb0ca3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ca25937a-a517-4703-865f-b8b56e6121f2, kind: Service { id: df2b7432-0b0b-4a35-b8ff-ef158746030c }, name: Name("nexus-df2b7432-0b0b-4a35-b8ff-ef158746030c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d02a8d8a-46f3-4481-ab51-ce89f99b1876, kind: Service { id: 4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 }, name: Name("nexus-4564acd5-ab8b-4cc2-a3ff-f2ca5150f960"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 108])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15932024-05-23T04:10:52.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15942024-05-23T04:10:52.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15952024-05-23T04:10:52.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15962024-05-23T04:10:52.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15972024-05-23T04:10:52.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
15982024-05-23T04:10:52.719ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15992024-05-23T04:10:52.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34142 req_id = 5d049fac-9e1b-40a1-b740-e90a768e628e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16002024-05-23T04:10:52.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48422
16012024-05-23T04:10:52.728ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bae2e19-c01b-45b3-a2b1-260f88697c91, kind: Service { id: f9573800-1c30-4708-8269-a1bc860b0a8b }, name: Name("external-dns-f9573800-1c30-4708-8269-a1bc860b0a8b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 212])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: daf22ce3-9615-4919-8bb1-c8d0aa6f0b23, kind: Service { id: b7d8321e-1700-42d0-afe3-6ec09f05b351 }, name: Name("external-dns-b7d8321e-1700-42d0-afe3-6ec09f05b351"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 175])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 887842f8-32a8-41a3-a35f-525853cc566e, kind: Service { id: 3fa2c857-fe52-4624-9e17-989085eb0ca3 }, name: Name("nexus-3fa2c857-fe52-4624-9e17-989085eb0ca3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ca25937a-a517-4703-865f-b8b56e6121f2, kind: Service { id: df2b7432-0b0b-4a35-b8ff-ef158746030c }, name: Name("nexus-df2b7432-0b0b-4a35-b8ff-ef158746030c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d02a8d8a-46f3-4481-ab51-ce89f99b1876, kind: Service { id: 4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 }, name: Name("nexus-4564acd5-ab8b-4cc2-a3ff-f2ca5150f960"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 108])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16022024-05-23T04:10:52.728ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16032024-05-23T04:10:52.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16042024-05-23T04:10:52.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16052024-05-23T04:10:52.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16062024-05-23T04:10:52.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
16072024-05-23T04:10:52.729ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16082024-05-23T04:10:52.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 732 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48422 req_id = 62ac8575-f61f-4f52-a519-a6d34213a87a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16092024-05-23T04:10:52.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52293
16102024-05-23T04:10:52.836ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bae2e19-c01b-45b3-a2b1-260f88697c91, kind: Service { id: f9573800-1c30-4708-8269-a1bc860b0a8b }, name: Name("external-dns-f9573800-1c30-4708-8269-a1bc860b0a8b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 212])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: daf22ce3-9615-4919-8bb1-c8d0aa6f0b23, kind: Service { id: b7d8321e-1700-42d0-afe3-6ec09f05b351 }, name: Name("external-dns-b7d8321e-1700-42d0-afe3-6ec09f05b351"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 175])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 887842f8-32a8-41a3-a35f-525853cc566e, kind: Service { id: 3fa2c857-fe52-4624-9e17-989085eb0ca3 }, name: Name("nexus-3fa2c857-fe52-4624-9e17-989085eb0ca3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ca25937a-a517-4703-865f-b8b56e6121f2, kind: Service { id: df2b7432-0b0b-4a35-b8ff-ef158746030c }, name: Name("nexus-df2b7432-0b0b-4a35-b8ff-ef158746030c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d02a8d8a-46f3-4481-ab51-ce89f99b1876, kind: Service { id: 4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 }, name: Name("nexus-4564acd5-ab8b-4cc2-a3ff-f2ca5150f960"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 108])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16112024-05-23T04:10:52.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16122024-05-23T04:10:52.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16132024-05-23T04:10:52.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16142024-05-23T04:10:52.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16152024-05-23T04:10:52.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
16162024-05-23T04:10:52.836ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16172024-05-23T04:10:52.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52293 req_id = a97c3598-fe04-40af-a502-c97c4563b986 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16182024-05-23T04:11:10.669ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:58632
16192024-05-23T04:11:10.670ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 602 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:58632 req_id = 2f394ea0-98c9-4b77-aa0e-6e893438eaa2 response_code = 200 uri = /baseboard
16202024-05-23T04:11:16.699ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57014
16212024-05-23T04:11:16.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1267 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57014 req_id = d5a6d02f-a139-4293-97d2-bd87c4f1bcde response_code = 200 uri = /v2p
16222024-05-23T04:11:16.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48020
16232024-05-23T04:11:16.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48020 req_id = 5b209949-8f61-49c1-bdcd-2d3de41e8cf0 response_code = 200 uri = /v2p
16242024-05-23T04:11:16.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35070
16252024-05-23T04:11:16.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35070 req_id = 6d1942ab-4f1d-47e1-909c-f940e8c00b21 response_code = 200 uri = /v2p
16262024-05-23T04:11:16.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57022
16272024-05-23T04:11:16.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 85994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57022 req_id = 80001732-7bef-4a73-ab1e-3a5de1a80252 response_code = 204 uri = /switch-ports
16282024-05-23T04:11:16.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46266
16292024-05-23T04:11:16.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 4251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57022 req_id = 3008b76e-ff40-4e24-894e-de4784994936 response_code = 200 uri = /network-bootstore-config
16302024-05-23T04:11:16.944ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
16312024-05-23T04:11:16.944ZINFOSledAgent (bootstore): Writing ledger to /pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16322024-05-23T04:11:16.946ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16332024-05-23T04:11:16.947ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
16342024-05-23T04:11:16.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3436 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57022 req_id = c4ab4965-44cc-4acd-8c93-43fd5d0b6fa9 response_code = 204 uri = /network-bootstore-config
16352024-05-23T04:11:16.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 53622 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46266 req_id = 6b7c0bb4-7f07-419a-a7e7-f573e29ecfe6 response_code = 204 uri = /switch-ports
16362024-05-23T04:11:16.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 835 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46266 req_id = 96ab74ef-b5bc-46c9-b2a8-760acbc783f2 response_code = 200 uri = /network-bootstore-config
16372024-05-23T04:11:16.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52313
16382024-05-23T04:11:17.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46972 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52313 req_id = cd3938f5-68c6-4fd5-906c-89f4aa44a3a9 response_code = 204 uri = /switch-ports
16392024-05-23T04:11:17.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52313 req_id = 59168598-88af-4941-a886-0dd79acc15fe response_code = 200 uri = /network-bootstore-config
16402024-05-23T04:11:36.436ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:60118 remote_addr = [fd00:1122:3344:101::d]:36298 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c
16412024-05-23T04:11:36.447ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 10956 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = 324d7839-dacc-4a6e-afb4-e65bf3872593 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
16422024-05-23T04:11:40.704ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47825
16432024-05-23T04:11:40.704ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 101 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47825 req_id = 94bc6608-2fd5-4046-bec4-49034c3a3e52 response_code = 200 uri = /baseboard
16442024-05-23T04:11:46.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33481
16452024-05-23T04:11:46.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1033 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33481 req_id = 114b1fb0-4c49-4904-80eb-b6aeb10ae6ac response_code = 200 uri = /v2p
16462024-05-23T04:11:46.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59900
16472024-05-23T04:11:46.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59900 req_id = 7725a8e1-7380-4071-9880-a2ad1fca20dd response_code = 200 uri = /v2p
16482024-05-23T04:11:46.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59959
16492024-05-23T04:11:46.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59959 req_id = 0d30301b-3740-4ce0-906a-9ed012cf8862 response_code = 200 uri = /v2p
16502024-05-23T04:11:47.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45720
16512024-05-23T04:11:47.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44855 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45720 req_id = f5c9f7c8-e886-4b4e-9a3d-257225891d11 response_code = 204 uri = /switch-ports
16522024-05-23T04:11:47.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45720 req_id = 8422aa01-f67b-441e-818e-02d8b9885a64 response_code = 200 uri = /network-bootstore-config
16532024-05-23T04:11:47.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64600
16542024-05-23T04:11:47.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44877 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64600 req_id = a7d030e5-3fd6-4ddf-9457-3081b82b12ff response_code = 204 uri = /switch-ports
16552024-05-23T04:11:47.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64600 req_id = 09a3c663-ea4d-40c1-a0d2-86ee55a21644 response_code = 200 uri = /network-bootstore-config
16562024-05-23T04:11:47.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44057
16572024-05-23T04:11:47.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 42063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44057 req_id = b65254b8-fc50-466c-ac37-355d94422276 response_code = 204 uri = /switch-ports
16582024-05-23T04:11:47.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44057 req_id = 40ec0d5d-a401-4575-986b-5457515e0897 response_code = 200 uri = /network-bootstore-config
16592024-05-23T04:11:58.439ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
16602024-05-23T04:12:06.434ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1109 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = f4575f80-5d07-46b1-9f15-0657e05030b6 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
16612024-05-23T04:12:10.736ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33420
16622024-05-23T04:12:10.736ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33420 req_id = 92aa71e2-c6da-4117-9eee-ee37c5c1f492 response_code = 200 uri = /baseboard
16632024-05-23T04:12:16.607ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58371
16642024-05-23T04:12:16.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 996 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58371 req_id = 6a31d9b8-1cbe-4bae-9bfe-1002301d39af response_code = 200 uri = /v2p
16652024-05-23T04:12:16.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62743
16662024-05-23T04:12:16.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62743 req_id = 3ed66616-e530-4600-b00e-2308a3c597c4 response_code = 200 uri = /v2p
16672024-05-23T04:12:16.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61504
16682024-05-23T04:12:16.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61504 req_id = a2059aca-44b5-4973-bac6-38e4e10ea2ef response_code = 200 uri = /v2p
16692024-05-23T04:12:16.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61753
16702024-05-23T04:12:16.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47079 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61753 req_id = e48f7ece-5fed-474c-9087-d5ffe5e34690 response_code = 204 uri = /switch-ports
16712024-05-23T04:12:16.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60329
16722024-05-23T04:12:16.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34279
16732024-05-23T04:12:16.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3551 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61753 req_id = bbdf2ad9-e929-4ec1-88b8-f6e9e44d039f response_code = 200 uri = /network-bootstore-config
16742024-05-23T04:12:16.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44565 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60329 req_id = 482bcf95-0ea1-425b-9d5f-eded1f009205 response_code = 204 uri = /switch-ports
16752024-05-23T04:12:16.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 485 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60329 req_id = 4df9dfa4-a586-48ed-b6c8-f8948f0d3edc response_code = 200 uri = /network-bootstore-config
16762024-05-23T04:12:16.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 85575 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34279 req_id = 3a51ad0a-b542-41e9-b8f0-86d4e5fa04ce response_code = 204 uri = /switch-ports
16772024-05-23T04:12:16.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34279 req_id = b7ccae5e-15cd-4b41-8ca5-f2237a7bfe19 response_code = 200 uri = /network-bootstore-config
16782024-05-23T04:12:36.433ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 503 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = 03b82d5c-d5e0-49a3-8a98-f8b610482857 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
16792024-05-23T04:12:40.769ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35529
16802024-05-23T04:12:40.769ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35529 req_id = 4cc94759-725f-4157-8bad-1b19f191ef47 response_code = 200 uri = /baseboard
16812024-05-23T04:12:46.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63941
16822024-05-23T04:12:46.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63941 req_id = 89ef5948-61a1-4fcf-99a9-4fca720a00d8 response_code = 200 uri = /v2p
16832024-05-23T04:12:46.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58901
16842024-05-23T04:12:46.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1313 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58901 req_id = 886ee3ec-cb9c-4ff8-acd6-3be8c127e867 response_code = 200 uri = /v2p
16852024-05-23T04:12:46.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37838
16862024-05-23T04:12:46.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37838 req_id = aec6d267-5485-4d94-a9cd-c0a2aa99432f response_code = 200 uri = /v2p
16872024-05-23T04:12:46.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58717
16882024-05-23T04:12:46.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 48187 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58717 req_id = ef6923cd-2f2e-4aa8-a65a-02ebb3961e23 response_code = 204 uri = /switch-ports
16892024-05-23T04:12:46.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57351
16902024-05-23T04:12:46.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 2733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58717 req_id = bd9fc7e5-6203-4e67-8f6e-3f719b251649 response_code = 200 uri = /network-bootstore-config
16912024-05-23T04:12:47.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 42608 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57351 req_id = 12b88e0d-99ba-475c-9018-7e4e3983c21c response_code = 204 uri = /switch-ports
16922024-05-23T04:12:47.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57351 req_id = b2fcae15-7878-4b84-8d45-141553f43ba6 response_code = 200 uri = /network-bootstore-config
16932024-05-23T04:12:47.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49356
16942024-05-23T04:12:47.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46931 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49356 req_id = 3e43ee00-fe67-49da-8b8a-3ff9f107048e response_code = 204 uri = /switch-ports
16952024-05-23T04:12:47.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49356 req_id = 0c314d1c-a0eb-4af3-890b-3df68fa2c708 response_code = 200 uri = /network-bootstore-config
16962024-05-23T04:13:06.434ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 674 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = c3d6601d-7a67-4295-b5c7-5e6d07bd8608 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
16972024-05-23T04:13:10.802ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33275
16982024-05-23T04:13:10.803ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 82 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33275 req_id = 6df30979-a1ce-49f6-a439-91f4293aa4b1 response_code = 200 uri = /baseboard
16992024-05-23T04:13:16.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53938
17002024-05-23T04:13:16.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53938 req_id = bcdd604f-140c-4c7c-be55-d3956f166922 response_code = 200 uri = /v2p
17012024-05-23T04:13:16.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35751
17022024-05-23T04:13:16.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35751 req_id = 750247e1-3e13-435a-ab8c-0dd38763db25 response_code = 200 uri = /v2p
17032024-05-23T04:13:16.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35819
17042024-05-23T04:13:16.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35819 req_id = b228499c-7bd0-4d0e-acc8-1d23addfea5c response_code = 200 uri = /v2p
17052024-05-23T04:13:16.680ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64874
17062024-05-23T04:13:16.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47792 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64874 req_id = 7536407e-7fac-48c7-9d50-ed87b12e0ce0 response_code = 204 uri = /switch-ports
17072024-05-23T04:13:16.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64874 req_id = bceb782e-02fb-44f7-b74b-292df95ae42f response_code = 200 uri = /network-bootstore-config
17082024-05-23T04:13:16.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38038
17092024-05-23T04:13:16.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46431 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38038 req_id = 77ef5f60-822a-4329-8cab-4284363fb05d response_code = 204 uri = /switch-ports
17102024-05-23T04:13:16.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38038 req_id = 3d394196-447f-428c-bc61-789d05906eb8 response_code = 200 uri = /network-bootstore-config
17112024-05-23T04:13:17.022ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48442
17122024-05-23T04:13:17.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 49012 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48442 req_id = 6dd789e0-4f5d-47b5-9f24-ea91a7cce817 response_code = 204 uri = /switch-ports
17132024-05-23T04:13:17.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48442 req_id = acadfbd2-e7a4-4101-b0d8-ed3758f21eca response_code = 200 uri = /network-bootstore-config
17142024-05-23T04:13:36.441ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 465 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = 14b2699b-9864-4cc1-b362-0fb6e5f1c318 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
17152024-05-23T04:13:40.837ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55294
17162024-05-23T04:13:40.838ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 663 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55294 req_id = 952036a8-0b5f-4562-8483-57f18516207b response_code = 200 uri = /baseboard
17172024-05-23T04:13:46.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36692
17182024-05-23T04:13:46.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36692 req_id = ed4b4b18-9f77-4d02-8755-9865309319db response_code = 200 uri = /v2p
17192024-05-23T04:13:46.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49777
17202024-05-23T04:13:46.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1408 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49777 req_id = 1584fe9d-128f-4f54-a4f1-0bce9b41b2ad response_code = 200 uri = /v2p
17212024-05-23T04:13:46.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51712
17222024-05-23T04:13:46.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51712 req_id = 04504219-1caf-4ef1-b0eb-382f32d068f4 response_code = 200 uri = /v2p
17232024-05-23T04:13:46.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44969
17242024-05-23T04:13:46.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 50619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44969 req_id = 8e4cb051-fd7b-4f22-a6f5-12a6f7f4060f response_code = 204 uri = /switch-ports
17252024-05-23T04:13:46.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 989 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44969 req_id = a2fa87d4-5c83-48f4-8837-ae15b570544b response_code = 200 uri = /network-bootstore-config
17262024-05-23T04:13:46.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33840
17272024-05-23T04:13:47.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45145 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33840 req_id = 826ca4c6-ba9b-4a4a-b831-4651a57f1be9 response_code = 204 uri = /switch-ports
17282024-05-23T04:13:47.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33840 req_id = 34a42c69-a8e3-405b-b499-797dc59a774e response_code = 200 uri = /network-bootstore-config
17292024-05-23T04:13:47.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41465
17302024-05-23T04:13:47.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47063 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41465 req_id = 9fc6b52e-dd60-4b9a-b736-388ad96e5b54 response_code = 204 uri = /switch-ports
17312024-05-23T04:13:47.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41465 req_id = 367d1318-cf1e-407b-8d7a-3367d1274a99 response_code = 200 uri = /network-bootstore-config
17322024-05-23T04:14:06.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 903 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = d88a954a-e5aa-41b8-b290-52bcc2fc759b response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
17332024-05-23T04:14:10.870ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48775
17342024-05-23T04:14:10.870ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 87 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48775 req_id = efd12a0b-ae99-4e51-9e6a-930d98c57cbd response_code = 200 uri = /baseboard
17352024-05-23T04:14:16.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34183
17362024-05-23T04:14:16.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34183 req_id = d277efe0-f8f6-466a-8872-feccc9ad9651 response_code = 200 uri = /v2p
17372024-05-23T04:14:16.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59177
17382024-05-23T04:14:16.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59177 req_id = 3b4622b2-0a7f-46a5-b1fa-83e0af06bd5a response_code = 200 uri = /v2p
17392024-05-23T04:14:16.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57956
17402024-05-23T04:14:16.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57956 req_id = de5a3d05-8bbd-4380-bff7-66cfe358b696 response_code = 200 uri = /v2p
17412024-05-23T04:14:16.723ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43892
17422024-05-23T04:14:16.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46656 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43892 req_id = 42124f1a-5f15-4662-99b4-bdafe9ce8ba6 response_code = 204 uri = /switch-ports
17432024-05-23T04:14:16.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43892 req_id = 70c2b32d-ec67-42dc-bd3b-563c2ccf5999 response_code = 200 uri = /network-bootstore-config
17442024-05-23T04:14:16.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43758
17452024-05-23T04:14:16.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 48655 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43758 req_id = adc5e568-578f-42e2-8dad-67e194d8be9a response_code = 204 uri = /switch-ports
17462024-05-23T04:14:16.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38758
17472024-05-23T04:14:16.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43758 req_id = 4176d6cf-6f80-4341-99c4-1873146da685 response_code = 200 uri = /network-bootstore-config
17482024-05-23T04:14:16.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46520 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38758 req_id = 57ec0b4c-3ae8-4766-91ed-fbf2a1fde13c response_code = 204 uri = /switch-ports
17492024-05-23T04:14:16.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38758 req_id = 25e58dd7-16d2-458d-87b5-f8a04e56db7c response_code = 200 uri = /network-bootstore-config
17502024-05-23T04:14:36.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 584 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = d27c8f0c-e9a1-47f4-b14f-98a9adc691e7 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
17512024-05-23T04:14:40.902ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38069
17522024-05-23T04:14:40.902ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 92 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38069 req_id = 665897b6-9af1-4171-9875-ee2b463b93ae response_code = 200 uri = /baseboard
17532024-05-23T04:14:46.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58626
17542024-05-23T04:14:46.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58626 req_id = ba5b24cc-8724-43af-8e93-5a8aced14ce1 response_code = 200 uri = /v2p
17552024-05-23T04:14:46.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59027
17562024-05-23T04:14:46.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59027 req_id = af27c3d8-c62f-4f71-a4a9-0595df3e0199 response_code = 200 uri = /v2p
17572024-05-23T04:14:46.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56853
17582024-05-23T04:14:46.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56853 req_id = f81a6e30-38a0-4018-bc62-5090a6e81832 response_code = 200 uri = /v2p
17592024-05-23T04:14:46.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32908
17602024-05-23T04:14:46.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 49965 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32908 req_id = f3c46c2f-2307-49a4-b333-59629965c498 response_code = 204 uri = /switch-ports
17612024-05-23T04:14:46.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32908 req_id = 3f3923f6-1071-4fa0-a2f2-858dbdd33483 response_code = 200 uri = /network-bootstore-config
17622024-05-23T04:14:47.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42573
17632024-05-23T04:14:47.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 42332 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42573 req_id = 92ae4f39-8fc8-4ad2-8983-b547bbb66ebb response_code = 204 uri = /switch-ports
17642024-05-23T04:14:47.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56197
17652024-05-23T04:14:47.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3396 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42573 req_id = fcfa3ea5-f4ac-4fda-a6aa-70b589368992 response_code = 200 uri = /network-bootstore-config
17662024-05-23T04:14:47.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45072 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56197 req_id = 21be2b20-cf4d-4fa0-8e24-ad15dd1eca7c response_code = 204 uri = /switch-ports
17672024-05-23T04:14:47.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56197 req_id = 65ac2d74-da97-4037-8af1-2cb19c77c256 response_code = 200 uri = /network-bootstore-config
17682024-05-23T04:15:06.553ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 619 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = 77837075-66ec-47ff-a857-f149e366782b response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
17692024-05-23T04:15:10.936ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42557
17702024-05-23T04:15:10.936ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42557 req_id = 00b59494-fed2-4a52-8215-3c61e29fa180 response_code = 200 uri = /baseboard
17712024-05-23T04:15:16.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49867
17722024-05-23T04:15:16.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 976 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49867 req_id = a5f9d951-f08d-4f1d-879a-75fc48241f0c response_code = 200 uri = /v2p
17732024-05-23T04:15:16.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58515
17742024-05-23T04:15:16.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58515 req_id = c0333be5-4f22-4847-bb41-4355def91711 response_code = 200 uri = /v2p
17752024-05-23T04:15:16.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64140
17762024-05-23T04:15:16.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64140 req_id = b48b0f95-2aa7-440c-b2bb-f927b3827cc3 response_code = 200 uri = /v2p
17772024-05-23T04:15:16.670ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35716
17782024-05-23T04:15:16.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47542 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35716 req_id = 52812817-73f6-4397-8000-8df649aa682d response_code = 204 uri = /switch-ports
17792024-05-23T04:15:16.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35716 req_id = 05c4d993-0cb1-4e91-894a-28dea241dd38 response_code = 200 uri = /network-bootstore-config
17802024-05-23T04:15:16.828ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59180
17812024-05-23T04:15:16.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59180 req_id = ff12ad2b-810b-4a03-b39c-c5446e7e6a60 response_code = 204 uri = /switch-ports
17822024-05-23T04:15:16.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55453
17832024-05-23T04:15:16.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59180 req_id = c74066b7-042d-4a44-8cd4-f01f456f7a69 response_code = 200 uri = /network-bootstore-config
17842024-05-23T04:15:16.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46051 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55453 req_id = edde0f39-2dcb-4fe7-9a81-c449cedd7ea0 response_code = 204 uri = /switch-ports
17852024-05-23T04:15:16.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55453 req_id = aba0d4df-63f2-43ab-8fa0-d90a77da2019 response_code = 200 uri = /network-bootstore-config
17862024-05-23T04:15:36.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1282 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = 5220b8dd-a468-49ac-ba8d-82a6e7f8c586 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
17872024-05-23T04:15:40.970ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35273
17882024-05-23T04:15:40.970ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 93 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35273 req_id = 484ad653-16d9-4aaa-9543-b80abbe30308 response_code = 200 uri = /baseboard
17892024-05-23T04:15:46.587ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39160
17902024-05-23T04:15:46.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39160 req_id = 9e56f839-3451-4aac-a3eb-827c753207d6 response_code = 200 uri = /v2p
17912024-05-23T04:15:46.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62599
17922024-05-23T04:15:46.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1056 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62599 req_id = d203a2bd-a871-4fe8-858e-43eb2c23d68f response_code = 200 uri = /v2p
17932024-05-23T04:15:46.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35732
17942024-05-23T04:15:46.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35732 req_id = a97849b4-5678-4e2f-b19c-bfc5fd74b59b response_code = 200 uri = /v2p
17952024-05-23T04:15:46.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54665
17962024-05-23T04:15:46.808ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bae2e19-c01b-45b3-a2b1-260f88697c91, kind: Service { id: f9573800-1c30-4708-8269-a1bc860b0a8b }, name: Name("external-dns-f9573800-1c30-4708-8269-a1bc860b0a8b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 212])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: daf22ce3-9615-4919-8bb1-c8d0aa6f0b23, kind: Service { id: b7d8321e-1700-42d0-afe3-6ec09f05b351 }, name: Name("external-dns-b7d8321e-1700-42d0-afe3-6ec09f05b351"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 175])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 887842f8-32a8-41a3-a35f-525853cc566e, kind: Service { id: 3fa2c857-fe52-4624-9e17-989085eb0ca3 }, name: Name("nexus-3fa2c857-fe52-4624-9e17-989085eb0ca3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ca25937a-a517-4703-865f-b8b56e6121f2, kind: Service { id: df2b7432-0b0b-4a35-b8ff-ef158746030c }, name: Name("nexus-df2b7432-0b0b-4a35-b8ff-ef158746030c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d02a8d8a-46f3-4481-ab51-ce89f99b1876, kind: Service { id: 4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 }, name: Name("nexus-4564acd5-ab8b-4cc2-a3ff-f2ca5150f960"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 108])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17972024-05-23T04:15:46.808ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17982024-05-23T04:15:46.808ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17992024-05-23T04:15:46.808ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18002024-05-23T04:15:46.808ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18012024-05-23T04:15:46.809ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
18022024-05-23T04:15:46.809ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18032024-05-23T04:15:46.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1483 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54665 req_id = e55a8f47-1534-41cc-ad37-765be1c47abc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18042024-05-23T04:15:46.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38204
18052024-05-23T04:15:47.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 49701 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38204 req_id = 815c9e23-0b64-4c3f-9b4e-4e238f0dc970 response_code = 204 uri = /switch-ports
18062024-05-23T04:15:47.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35739
18072024-05-23T04:15:47.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37311
18082024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bae2e19-c01b-45b3-a2b1-260f88697c91, kind: Service { id: f9573800-1c30-4708-8269-a1bc860b0a8b }, name: Name("external-dns-f9573800-1c30-4708-8269-a1bc860b0a8b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 212])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: daf22ce3-9615-4919-8bb1-c8d0aa6f0b23, kind: Service { id: b7d8321e-1700-42d0-afe3-6ec09f05b351 }, name: Name("external-dns-b7d8321e-1700-42d0-afe3-6ec09f05b351"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 175])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 887842f8-32a8-41a3-a35f-525853cc566e, kind: Service { id: 3fa2c857-fe52-4624-9e17-989085eb0ca3 }, name: Name("nexus-3fa2c857-fe52-4624-9e17-989085eb0ca3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ca25937a-a517-4703-865f-b8b56e6121f2, kind: Service { id: df2b7432-0b0b-4a35-b8ff-ef158746030c }, name: Name("nexus-df2b7432-0b0b-4a35-b8ff-ef158746030c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d02a8d8a-46f3-4481-ab51-ce89f99b1876, kind: Service { id: 4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 }, name: Name("nexus-4564acd5-ab8b-4cc2-a3ff-f2ca5150f960"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 108])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18092024-05-23T04:15:47.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38204 req_id = 59a9d2ca-a40a-45fd-91da-39b760364368 response_code = 200 uri = /network-bootstore-config
18102024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18112024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18122024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18132024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 7bae2e19-c01b-45b3-a2b1-260f88697c91, kind: Service { id: f9573800-1c30-4708-8269-a1bc860b0a8b }, name: Name("external-dns-f9573800-1c30-4708-8269-a1bc860b0a8b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 254, 212])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: daf22ce3-9615-4919-8bb1-c8d0aa6f0b23, kind: Service { id: b7d8321e-1700-42d0-afe3-6ec09f05b351 }, name: Name("external-dns-b7d8321e-1700-42d0-afe3-6ec09f05b351"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 175])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.1.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 887842f8-32a8-41a3-a35f-525853cc566e, kind: Service { id: 3fa2c857-fe52-4624-9e17-989085eb0ca3 }, name: Name("nexus-3fa2c857-fe52-4624-9e17-989085eb0ca3"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 74])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ca25937a-a517-4703-865f-b8b56e6121f2, kind: Service { id: df2b7432-0b0b-4a35-b8ff-ef158746030c }, name: Name("nexus-df2b7432-0b0b-4a35-b8ff-ef158746030c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 132, 182])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: d02a8d8a-46f3-4481-ab51-ce89f99b1876, kind: Service { id: 4564acd5-ab8b-4cc2-a3ff-f2ca5150f960 }, name: Name("nexus-4564acd5-ab8b-4cc2-a3ff-f2ca5150f960"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 108])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.2.0, prefix: 24 })), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18142024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18152024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
18162024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18172024-05-23T04:15:47.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 500 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35739 req_id = 61f55864-afc4-424d-83db-a37b4830622a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18182024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18192024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18202024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18212024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18222024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
18232024-05-23T04:15:47.032ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18242024-05-23T04:15:47.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 488 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37311 req_id = 3cde50c5-afd9-4a5b-a13f-3d8bea12f282 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18252024-05-23T04:15:47.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51170
18262024-05-23T04:15:47.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51170 req_id = 661e2da9-2bfb-4370-996b-3a1d0c34193f response_code = 204 uri = /switch-ports
18272024-05-23T04:15:47.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 595 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51170 req_id = c4ff8e35-c5d4-43c8-a41d-c56304445cc7 response_code = 200 uri = /network-bootstore-config
18282024-05-23T04:15:47.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53483
18292024-05-23T04:15:47.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46478 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53483 req_id = b678928e-dc3b-4d50-a085-fe8f4e40fc6b response_code = 204 uri = /switch-ports
18302024-05-23T04:15:47.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 724 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53483 req_id = 2ef5d3f4-68b1-4735-8b09-0071e55d82d1 response_code = 200 uri = /network-bootstore-config
18312024-05-23T04:16:06.554ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1205 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = de5f589e-3adc-49c0-8cd0-07a0b1c074aa response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
18322024-05-23T04:16:11.003ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33334
18332024-05-23T04:16:11.003ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 85 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33334 req_id = 3189090e-66f4-407b-a9e0-0683da30b72c response_code = 200 uri = /baseboard
18342024-05-23T04:16:16.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35336
18352024-05-23T04:16:16.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35336 req_id = 9f72bdee-1bcc-4503-956d-54dc84d46bb0 response_code = 200 uri = /v2p
18362024-05-23T04:16:16.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51784
18372024-05-23T04:16:16.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51784 req_id = 9bba07cd-29cb-4ac0-85d0-48cf98ec7335 response_code = 200 uri = /v2p
18382024-05-23T04:16:16.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44190
18392024-05-23T04:16:16.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 48120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44190 req_id = 260b0087-f66d-4728-ad4e-1b5d202fa855 response_code = 204 uri = /switch-ports
18402024-05-23T04:16:16.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37773
18412024-05-23T04:16:16.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37773 req_id = ac57e030-b3c8-4c97-9a53-fabcddc161f0 response_code = 200 uri = /v2p
18422024-05-23T04:16:16.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 748 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44190 req_id = aa700200-1462-4341-baa9-b6da2ad925d7 response_code = 200 uri = /network-bootstore-config
18432024-05-23T04:16:16.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64704
18442024-05-23T04:16:16.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 46789 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64704 req_id = 5ad263d4-5ddd-45a3-9111-68f399e8bd2b response_code = 204 uri = /switch-ports
18452024-05-23T04:16:16.876ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64704 req_id = fe000b31-ff90-441e-a7ab-c73b4b53d2ef response_code = 200 uri = /network-bootstore-config
18462024-05-23T04:16:17.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61652
18472024-05-23T04:16:17.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 44452 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61652 req_id = d889c788-263c-43d7-acc4-f865ec44ae3f response_code = 204 uri = /switch-ports
18482024-05-23T04:16:17.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61652 req_id = 2f94496e-e6c4-4a98-87ee-4144ef7abd53 response_code = 200 uri = /network-bootstore-config
18492024-05-23T04:16:36.641ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1220 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = 0b050b07-749f-452f-ad9a-fa879155d3e6 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
18502024-05-23T04:16:41.035ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49784
18512024-05-23T04:16:41.036ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 631 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49784 req_id = bc24d386-711a-4885-8695-367539c52c74 response_code = 200 uri = /baseboard
18522024-05-23T04:16:44.521ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:300
18532024-05-23T04:16:44.521ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
18542024-05-23T04:16:44.556ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 2071, tv_nsec: 764988602 } time_to_next_cleanup = 599.99999452s
18552024-05-23T04:16:46.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41882
18562024-05-23T04:16:46.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41882 req_id = 73de92a5-1b24-4422-9754-c28117c4fa91 response_code = 200 uri = /v2p
18572024-05-23T04:16:46.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34045
18582024-05-23T04:16:46.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34045 req_id = 9ab7311b-55a9-4052-9d5b-2f70862c82cd response_code = 200 uri = /v2p
18592024-05-23T04:16:46.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57432
18602024-05-23T04:16:46.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57432 req_id = 0612bc6b-e64b-4434-adc6-b124ba7221c5 response_code = 200 uri = /v2p
18612024-05-23T04:16:46.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45850
18622024-05-23T04:16:47.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45850 req_id = 76bc97ab-3c84-4f99-9802-951225fc462e response_code = 204 uri = /switch-ports
18632024-05-23T04:16:47.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44228
18642024-05-23T04:16:47.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45850 req_id = 8e0ef46c-9f27-478e-b0e8-e667027a5deb response_code = 200 uri = /network-bootstore-config
18652024-05-23T04:16:47.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 48182 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44228 req_id = 4461fb31-c49f-4050-af48-292fd4317ca6 response_code = 204 uri = /switch-ports
18662024-05-23T04:16:47.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 677 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44228 req_id = 11d94e97-69ab-41ae-b9a4-e4bcfe68cb52 response_code = 200 uri = /network-bootstore-config
18672024-05-23T04:16:47.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59061
18682024-05-23T04:16:47.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 43605 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59061 req_id = 3ac7b1fb-c110-4a3f-8909-bed9453400b8 response_code = 204 uri = /switch-ports
18692024-05-23T04:16:47.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59061 req_id = 8f20063f-aa51-4bb7-8c53-751f507e4872 response_code = 200 uri = /network-bootstore-config
18702024-05-23T04:16:58.441ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
18712024-05-23T04:17:06.641ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1030 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = c9ce40a5-d2db-4f48-876e-5b2fa5d7f806 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
18722024-05-23T04:17:11.071ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42877
18732024-05-23T04:17:11.071ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42877 req_id = 1a0d6cc5-dbe2-4564-b641-b1661d91d78d response_code = 200 uri = /baseboard
18742024-05-23T04:17:16.320ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47739
18752024-05-23T04:17:16.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 691 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47739 req_id = 9035c163-1d25-4a77-9605-f7ce04ed9736 response_code = 200 uri = /v2p
18762024-05-23T04:17:16.324ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(15564614) }
18772024-05-23T04:17:16.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 889 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47739 req_id = b5ae981e-d1f2-40e2-9354-968171abfac1 response_code = 204 uri = /v2p
18782024-05-23T04:17:16.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51844
18792024-05-23T04:17:16.500ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:546 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: dfdd1b92-bee2-40b9-b232-dfc4931da944, kind: Instance { id: 54cead87-aa35-4357-a19b-4848426dedb5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15564614), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfdd1b92-bee2-40b9-b232-dfc4931da944, kind: Instance { id: 54cead87-aa35-4357-a19b-4848426dedb5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15564614), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfdd1b92-bee2-40b9-b232-dfc4931da944, kind: Instance { id: 54cead87-aa35-4357-a19b-4848426dedb5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15564614), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(15564614))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfdd1b92-bee2-40b9-b232-dfc4931da944, kind: Instance { id: 54cead87-aa35-4357-a19b-4848426dedb5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15564614), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-7f7b02916bd", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 15a87abc-32b1-4a9c-9eb5-58048e79279f, read_only_parent: Some(Volume { block_size: 512, id: 86d84916-ee3a-455c-b62b-e248940af856, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2deccf3e-14fd-4d82-8d8e-455312119369, key: Some("vmI4NZpiNl8jTtXNQA1awVg+dtL5fPBhr5C7FkiAi6U="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 15a87abc-32b1-4a9c-9eb5-58048e79279f, key: Some("ASbdlPqlZaQ7FfqULWbtnO/FPV1t4wKjoH9qTCVWSgU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::16]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAtKCK3WLdYAAAoIrdYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAALSgit1i3WAAAKCK3WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI1NGNlYWQ4Ny1hYTM1LTQzNTctYTE5Yi00ODQ4NDI2ZGVkYjUiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTVdPb0t6aGNkZG5rcjJpcFQzNTRzdW80MnkvWUhqVi9EK1IvOXlDeW40aiJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 instance_runtime = InstanceRuntimeState { propolis_id: Some(2844c958-9e9c-42ad-89bb-e44161f9f3da), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-23T04:17:16.101155511Z } metadata = InstanceMetadata { silo_id: 29f70470-b569-435f-b6a9-e89b9b18ef9a, project_id: 6d860500-887d-4214-84a7-e0e714f2af13 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 2844c958-9e9c-42ad-89bb-e44161f9f3da vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-05-23T04:17:16.074238Z }
18802024-05-23T04:17:16.500ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:580 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
18812024-05-23T04:17:16.500ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:938 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 propolis_id = 2844c958-9e9c-42ad-89bb-e44161f9f3da state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: dfdd1b92-bee2-40b9-b232-dfc4931da944, kind: Instance { id: 54cead87-aa35-4357-a19b-4848426dedb5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15564614), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfdd1b92-bee2-40b9-b232-dfc4931da944, kind: Instance { id: 54cead87-aa35-4357-a19b-4848426dedb5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15564614), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfdd1b92-bee2-40b9-b232-dfc4931da944, kind: Instance { id: 54cead87-aa35-4357-a19b-4848426dedb5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15564614), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(15564614))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: dfdd1b92-bee2-40b9-b232-dfc4931da944, kind: Instance { id: 54cead87-aa35-4357-a19b-4848426dedb5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), subnet: V4(Ipv4Net(Ipv4Network { addr: 172.30.0.0, prefix: 22 })), vni: Vni(15564614), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-7f7b02916bd", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 15a87abc-32b1-4a9c-9eb5-58048e79279f, read_only_parent: Some(Volume { block_size: 512, id: 86d84916-ee3a-455c-b62b-e248940af856, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2deccf3e-14fd-4d82-8d8e-455312119369, key: Some("vmI4NZpiNl8jTtXNQA1awVg+dtL5fPBhr5C7FkiAi6U="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 15a87abc-32b1-4a9c-9eb5-58048e79279f, key: Some("ASbdlPqlZaQ7FfqULWbtnO/FPV1t4wKjoH9qTCVWSgU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::16]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAtKCK3WLdYAAAoIrdYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAALSgit1i3WAAAKCK3WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI1NGNlYWQ4Ny1hYTM1LTQzNTctYTE5Yi00ODQ4NDI2ZGVkYjUiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTVdPb0t6aGNkZG5rcjJpcFQzNTRzdW80MnkvWUhqVi9EK1IvOXlDeW40aiJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(2844c958-9e9c-42ad-89bb-e44161f9f3da), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-23T04:17:16.101155511Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-05-23T04:17:16.074238Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
18822024-05-23T04:17:16.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51844 req_id = 2b9dfa91-fc4f-41de-b566-e4afd80514e7 response_code = 200 uri = /instances/54cead87-aa35-4357-a19b-4848426dedb5
18832024-05-23T04:17:16.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46532
18842024-05-23T04:17:16.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 1128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46532 req_id = 3a21737e-9281-4617-a4e7-dcbc1f6cdb2a response_code = 200 uri = /v2p
18852024-05-23T04:17:16.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61457
18862024-05-23T04:17:16.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61457 req_id = 7c38bca2-cac3-4d1c-882b-543c5e345a85 response_code = 200 uri = /instances/54cead87-aa35-4357-a19b-4848426dedb5/state
18872024-05-23T04:17:16.645ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49469
18882024-05-23T04:17:16.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49469 req_id = 4f9e74ed-7a3e-421b-8ed1-ed446700e4f0 response_code = 200 uri = /instances/54cead87-aa35-4357-a19b-4848426dedb5/state
18892024-05-23T04:17:16.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51283
18902024-05-23T04:17:16.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51283 req_id = b3408111-1794-4679-ac1f-f6bebbd50cac response_code = 200 uri = /v2p
18912024-05-23T04:17:16.692ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53487
18922024-05-23T04:17:16.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53487 req_id = effe2deb-36a2-4d38-a8e4-62456c770a67 response_code = 200 uri = /instances/54cead87-aa35-4357-a19b-4848426dedb5/state
18932024-05-23T04:17:16.759ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59902
18942024-05-23T04:17:16.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47483 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59902 req_id = e23c85ae-db9b-4e14-bb71-5023da26caf9 response_code = 204 uri = /switch-ports
18952024-05-23T04:17:16.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45899
18962024-05-23T04:17:16.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 3181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59902 req_id = 01f9ea61-bba0-4f45-85c3-b1af1cc794b7 response_code = 200 uri = /network-bootstore-config
18972024-05-23T04:17:16.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42166
18982024-05-23T04:17:16.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42166 req_id = f111c4c3-7fc6-4a74-8c18-a783f6d0504e response_code = 200 uri = /v2p
18992024-05-23T04:17:16.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60075
19002024-05-23T04:17:16.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60075 req_id = d178f6c0-0a7e-4532-8350-de85c7af5a4c response_code = 200 uri = /instances/54cead87-aa35-4357-a19b-4848426dedb5/state
19012024-05-23T04:17:16.845ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 244, 75, 39]), slot: 0, vni: Vni { inner: 15564614 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
19022024-05-23T04:17:16.845ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19032024-05-23T04:17:16.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 47140 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45899 req_id = 68d02589-5e66-4d6a-8488-bbbdae600f9c response_code = 204 uri = /switch-ports
19042024-05-23T04:17:16.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45899 req_id = f3edb298-85eb-450e-b4b8-cdab461f0072 response_code = 200 uri = /network-bootstore-config
19052024-05-23T04:17:16.880ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da file = illumos-utils/src/zone.rs:315 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19062024-05-23T04:17:16.893ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51836
19072024-05-23T04:17:16.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 45485 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51836 req_id = a352f234-b686-42d5-bb09-1c9eaa1320f7 response_code = 204 uri = /switch-ports
19082024-05-23T04:17:16.939ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da file = illumos-utils/src/zone.rs:354 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19092024-05-23T04:17:16.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51836 req_id = 489da32a-1f66-4bef-be41-c454cadfa9ff response_code = 200 uri = /network-bootstore-config
19102024-05-23T04:17:18.073ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::b]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19112024-05-23T04:17:18.074ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 zone = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19122024-05-23T04:17:18.266ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 71.099874ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 zone = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19132024-05-23T04:17:18.352ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 55.59454ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 zone = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19142024-05-23T04:17:18.423ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 182.360198ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 zone = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19152024-05-23T04:17:18.622ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 394.631679ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 zone = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19162024-05-23T04:17:19.031ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 1.035346457s file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 zone = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19172024-05-23T04:17:20.078ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 856.985526ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 zone = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19182024-05-23T04:17:20.945ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 1.277673021s file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 zone = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19192024-05-23T04:17:22.233ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 820.516233ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 zone = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19202024-05-23T04:17:23.085ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da file = sled-agent/src/instance.rs:1423 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19212024-05-23T04:17:23.094ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 45.854747ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19222024-05-23T04:17:23.150ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 84.792134ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19232024-05-23T04:17:23.245ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 119.847013ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19242024-05-23T04:17:23.376ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 226.963235ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19252024-05-23T04:17:23.611ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da") failed: Property not found. retry in 985.624839ms file = illumos-utils/src/svc.rs:36 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19262024-05-23T04:17:24.607ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1432 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19272024-05-23T04:17:24.641ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1446 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19282024-05-23T04:17:24.642ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAAtKCK3WLdYAAAoIrdYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAALSgit1i3WAAAKCK3WAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI1NGNlYWQ4Ny1hYTM1LTQzNTctYTE5Yi00ODQ4NDI2ZGVkYjUiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTVdPb0t6aGNkZG5rcjJpcFQzNTRzdW80MnkvWUhqVi9EK1IvOXlDeW40aiJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-7f7b02916bd", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 15a87abc-32b1-4a9c-9eb5-58048e79279f, read_only_parent: Some(Volume { block_size: 512, id: 86d84916-ee3a-455c-b62b-e248940af856, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 2deccf3e-14fd-4d82-8d8e-455312119369, key: Some("vmI4NZpiNl8jTtXNQA1awVg+dtL5fPBhr5C7FkiAi6U="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::13]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 15a87abc-32b1-4a9c-9eb5-58048e79279f, key: Some("ASbdlPqlZaQ7FfqULWbtnO/FPV1t4wKjoH9qTCVWSgU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19001", "[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::16]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: 54cead87-aa35-4357-a19b-4848426dedb5, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 6d860500-887d-4214-84a7-e0e714f2af13, silo_id: 29f70470-b569-435f-b6a9-e89b9b18ef9a }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:685 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19292024-05-23T04:17:24.731ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:687 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19302024-05-23T04:17:24.732ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-05-23T04:17:24.732223323Z } file = sled-agent/src/instance.rs:569 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19312024-05-23T04:17:24.732ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 new_instance_state = InstanceRuntimeState { propolis_id: Some(2844c958-9e9c-42ad-89bb-e44161f9f3da), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-23T04:17:16.101155511Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-05-23T04:17:24.732223323Z } propolis_id = 2844c958-9e9c-42ad-89bb-e44161f9f3da
19322024-05-23T04:17:24.732ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(2844c958-9e9c-42ad-89bb-e44161f9f3da), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-23T04:17:16.101155511Z }, propolis_id: 2844c958-9e9c-42ad-89bb-e44161f9f3da, vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-05-23T04:17:24.732223323Z } }
19332024-05-23T04:17:24.791ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-05-23T04:17:24.791145119Z } file = sled-agent/src/instance.rs:569 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19342024-05-23T04:17:24.791ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 new_instance_state = InstanceRuntimeState { propolis_id: Some(2844c958-9e9c-42ad-89bb-e44161f9f3da), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-23T04:17:16.101155511Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-05-23T04:17:24.791145119Z } propolis_id = 2844c958-9e9c-42ad-89bb-e44161f9f3da
19352024-05-23T04:17:24.791ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(2844c958-9e9c-42ad-89bb-e44161f9f3da), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-23T04:17:16.101155511Z }, propolis_id: 2844c958-9e9c-42ad-89bb-e44161f9f3da, vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-05-23T04:17:24.791145119Z } }
19362024-05-23T04:17:33.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33828
19372024-05-23T04:17:33.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 742 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33828 req_id = b64bac8a-216f-472e-835a-d93a9aa1728f response_code = 200 uri = /instances/54cead87-aa35-4357-a19b-4848426dedb5/state
19382024-05-23T04:17:33.722ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-05-23T04:17:33.721995095Z } file = sled-agent/src/instance.rs:569 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19392024-05-23T04:17:33.722ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 new_instance_state = InstanceRuntimeState { propolis_id: Some(2844c958-9e9c-42ad-89bb-e44161f9f3da), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-23T04:17:16.101155511Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-05-23T04:17:33.721995095Z } propolis_id = 2844c958-9e9c-42ad-89bb-e44161f9f3da
19402024-05-23T04:17:33.722ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(2844c958-9e9c-42ad-89bb-e44161f9f3da), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-05-23T04:17:16.101155511Z }, propolis_id: 2844c958-9e9c-42ad-89bb-e44161f9f3da, vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-05-23T04:17:33.721995095Z } }
19412024-05-23T04:17:33.744ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-05-23T04:17:33.744161867Z } file = sled-agent/src/instance.rs:569 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19422024-05-23T04:17:33.744ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-23T04:17:33.744161867Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-05-23T04:17:33.744161867Z } propolis_id = 2844c958-9e9c-42ad-89bb-e44161f9f3da
19432024-05-23T04:17:33.744ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:606 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19442024-05-23T04:17:33.744ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19452024-05-23T04:17:33.744ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
19462024-05-23T04:17:33.744ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/00f23dd2-ec1c-47ae-955f-67169b6e6535/debug/bundle/zone", "/pool/int/dc107f05-7499-4442-b1eb-bd9424553a87/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/8c0011d1-3f05-4d38-94bb-2f22c941a173/crypt/debug", "/pool/ext/6104f922-62c0-4d69-bcb4-36106df31285/crypt/debug", "/pool/ext/c8494e8d-81d4-4f28-a951-0cf5ebb7e4ec/crypt/debug", "/pool/ext/7a0ba1c9-0994-46ee-848a-8efaae776d11/crypt/debug", "/pool/ext/3a7bfe6e-072c-4ebb-9b60-d5b326d0b61a/crypt/debug", "/pool/ext/127f2afe-c507-4a93-ad56-3834e79f35c8/crypt/debug", "/pool/ext/31801aa5-cbc2-46ad-8317-204ec0a5cef6/crypt/debug", "/pool/ext/5a5099d0-f1bf-4240-9fa6-ee6f06d5f77d/crypt/debug", "/pool/ext/b755abc1-d573-403a-80b5-740c5b5b87fd/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da
19472024-05-23T04:17:34.370ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da", bundle_id: 102a65e7-83dd-432f-8746-d44e153ce254 }, time_created: 2024-05-23T04:17:33.744774157Z, version: 0, cause: TerminatedInstance }
19482024-05-23T04:17:34.370ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_2844c958-9e9c-42ad-89bb-e44161f9f3da file = sled-agent/src/instance.rs:780 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19492024-05-23T04:17:36.138ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19502024-05-23T04:17:36.164ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-23T04:17:33.744161867Z }, propolis_id: 2844c958-9e9c-42ad-89bb-e44161f9f3da, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-05-23T04:17:36.164509032Z } }
19512024-05-23T04:17:36.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52641
19522024-05-23T04:17:36.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52641 req_id = 973718ee-ca6e-45cd-8d3d-a470314b73fa response_code = 200 uri = /v2p
19532024-05-23T04:17:36.267ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(15564614) }
19542024-05-23T04:17:36.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52641 req_id = 9af527c5-bb1c-4cc4-95fa-853f1dc5a330 response_code = 204 uri = /v2p
19552024-05-23T04:17:36.465ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-05-23T04:17:33.744161867Z }, propolis_id: 2844c958-9e9c-42ad-89bb-e44161f9f3da, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-05-23T04:17:36.164509032Z } }
19562024-05-23T04:17:36.468ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:723 instance_id = 54cead87-aa35-4357-a19b-4848426dedb5
19572024-05-23T04:17:36.641ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 542 local_addr = [fd00:1122:3344:101::1]:60118 method = GET remote_addr = [fd00:1122:3344:101::d]:36298 req_id = 5b0f3c9f-6755-4cf6-ab0f-c9e9633b48e1 response_code = 200 sled_id = dc42437e-f158-48dc-b8b5-096274c6457c uri = /dc42437e-f158-48dc-b8b5-096274c6457c
19582024-05-23T04:17:36.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50054
19592024-05-23T04:17:36.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50054 req_id = 481fcfd6-a27b-499f-ba78-8693d6033d18 response_code = 200 uri = /v2p
19602024-05-23T04:17:36.680ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:671 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 244, 75, 39])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(15564614) }
19612024-05-23T04:17:36.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/2fdf371/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:50054 req_id = 7f1cec0d-6937-429c-966d-b362dde3bada response_code = 204 uri = /v2p