Max level shown:
1 [ Jun 12 21:22:10 Enabled. ]
2 [ Jun 12 21:22:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jun 12 21:22:10 Method "start" exited with status 0. ]
4 [ Jun 12 21:22:10 Rereading configuration. ]
5 [ Jun 12 21:22:10 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-06-12T21:22:10.072ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-06-12T21:22:10.073ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-06-12T21:22:10.127ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-06-12T21:22:10.127ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-06-12T21:22:10.241ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-06-12T21:22:10.250ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-06-12T21:22:10.258ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-06-12T21:22:10.859ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fdb0:18c0:4d0d:a02a::, len: 64 }
152024-06-12T21:22:11.000ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-06-12T21:22:11.000ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-06-12T21:22:11.000ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-06-12T21:22:11.001ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-06-12T21:22:11.001ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:506
202024-06-12T21:22:11.001ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:625
212024-06-12T21:22:11.004ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:535
222024-06-12T21:22:11.004ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:674
232024-06-12T21:22:11.004ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242024-06-12T21:22:11.004ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:733
252024-06-12T21:22:11.004ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
262024-06-12T21:22:11.004ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = None
272024-06-12T21:22:11.004ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }), tx: ... } file = sled-storage/src/manager.rs:381
282024-06-12T21:22:11.004ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-06-12T21:22:11.004ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-06-12T21:22:11.015ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:304
312024-06-12T21:22:11.015ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool)
322024-06-12T21:22:11.112ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal }
332024-06-12T21:22:11.319ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
342024-06-12T21:22:11.319ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
352024-06-12T21:22:11.319ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-06-12T21:22:11.319ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-06-12T21:22:11.319ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }), tx: ... } file = sled-storage/src/manager.rs:381
382024-06-12T21:22:11.319ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-06-12T21:22:11.319ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-06-12T21:22:11.328ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:304
412024-06-12T21:22:11.328ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:315 id = e0099430-147d-4db6-a892-0d1b36d80310 (zpool)
422024-06-12T21:22:11.414ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal }
432024-06-12T21:22:11.618ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
442024-06-12T21:22:11.618ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
452024-06-12T21:22:11.618ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
462024-06-12T21:22:11.618ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
472024-06-12T21:22:11.618ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }), tx: ... } file = sled-storage/src/manager.rs:381
482024-06-12T21:22:11.618ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-06-12T21:22:11.618ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
502024-06-12T21:22:11.618ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
512024-06-12T21:22:11.618ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
522024-06-12T21:22:11.618ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
532024-06-12T21:22:11.618ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }), tx: ... } file = sled-storage/src/manager.rs:381
542024-06-12T21:22:11.618ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-06-12T21:22:11.618ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
562024-06-12T21:22:11.618ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }), tx: ... } file = sled-storage/src/manager.rs:381
572024-06-12T21:22:11.618ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
582024-06-12T21:22:11.618ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
592024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
602024-06-12T21:22:11.619ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
612024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
622024-06-12T21:22:11.619ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }), tx: ... } file = sled-storage/src/manager.rs:381
632024-06-12T21:22:11.619ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
642024-06-12T21:22:11.619ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
662024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
672024-06-12T21:22:11.619ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
682024-06-12T21:22:11.619ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }), tx: ... } file = sled-storage/src/manager.rs:381
692024-06-12T21:22:11.619ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702024-06-12T21:22:11.619ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
712024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
722024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
732024-06-12T21:22:11.619ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
742024-06-12T21:22:11.619ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }), tx: ... } file = sled-storage/src/manager.rs:381
752024-06-12T21:22:11.619ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
762024-06-12T21:22:11.619ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
782024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
792024-06-12T21:22:11.619ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
802024-06-12T21:22:11.619ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
812024-06-12T21:22:11.619ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }), tx: ... } file = sled-storage/src/manager.rs:381
822024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
832024-06-12T21:22:11.619ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
842024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
852024-06-12T21:22:11.619ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
862024-06-12T21:22:11.619ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
872024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
882024-06-12T21:22:11.619ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }), tx: ... } file = sled-storage/src/manager.rs:381
892024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
902024-06-12T21:22:11.619ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-06-12T21:22:11.619ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
922024-06-12T21:22:11.619ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }), tx: ... } file = sled-storage/src/manager.rs:381
932024-06-12T21:22:11.619ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
942024-06-12T21:22:11.619ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:494 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
952024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
962024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
972024-06-12T21:22:11.619ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
982024-06-12T21:22:11.619ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
992024-06-12T21:22:11.619ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:93
1002024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1012024-06-12T21:22:11.619ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1022024-06-12T21:22:11.619ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1032024-06-12T21:22:11.619ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
1042024-06-12T21:22:11.619ZINFOSledAgent (bootstore): No ledger in /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-06-12T21:22:11.619ZINFOSledAgent (bootstore): No ledger in /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-06-12T21:22:11.619ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-06-12T21:22:11.619ZINFOSledAgent (bootstore): No ledger in /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-06-12T21:22:11.619ZINFOSledAgent (bootstore): No ledger in /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-06-12T21:22:11.619ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-06-12T21:22:11.619ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
1112024-06-12T21:22:11.619ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
1122024-06-12T21:22:11.629ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:711
1132024-06-12T21:22:11.629ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1314, tv_nsec: 314692865 } time_to_next_cleanup = 599.999923638s
1142024-06-12T21:22:11.629ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3647
1152024-06-12T21:22:11.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1162024-06-12T21:22:11.630ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-06-12T21:22:11.631ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-06-12T21:22:11.632ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-06-12T21:22:11.632ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-06-12T21:22:11.633ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1011
1212024-06-12T21:22:11.633ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-06-12T21:22:11.633ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1232024-06-12T21:22:11.633ZINFOSledAgent (RSS): No ledger in /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-06-12T21:22:11.633ZINFOSledAgent (RSS): No ledger in /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-06-12T21:22:11.633ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1071
1262024-06-12T21:22:11.633ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1272024-06-12T21:22:11.633ZINFOSledAgent (RSS): No ledger in /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-06-12T21:22:11.633ZINFOSledAgent (RSS): No ledger in /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-06-12T21:22:11.633ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1112
1302024-06-12T21:22:11.633ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:118
1312024-06-12T21:22:11.633ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:91
1322024-06-12T21:22:11.633ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1332024-06-12T21:22:11.633ZINFOSledAgent (RSS): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-06-12T21:22:11.633ZINFOSledAgent (RSS): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-06-12T21:22:11.633ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:138
1362024-06-12T21:22:11.633ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1145
1372024-06-12T21:22:11.634ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-06-12T21:22:11.634ZINFOSledAgent (bootstore): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-06-12T21:22:11.634ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-06-12T21:22:11.634ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-06-12T21:22:11.634ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 3196594c-bc4a-474e-a0a2-7a0af521e0d4, rack_id: 4a59bdcc-0dd9-4487-9f85-3e04212a83c6, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-06-12T21:22:11.634ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:57111
1432024-06-12T21:22:11.634ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 3196594c-bc4a-474e-a0a2-7a0af521e0d4, rack_id: 4a59bdcc-0dd9-4487-9f85-3e04212a83c6, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:360
1442024-06-12T21:22:11.634ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1452024-06-12T21:22:11.634ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1462024-06-12T21:22:11.634ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1472024-06-12T21:22:11.634ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:101::, len: 64 }
1482024-06-12T21:22:11.634ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:381
1492024-06-12T21:22:11.634ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:530
1502024-06-12T21:22:11.634ZINFOSledAgent (StorageManager): No ledger in /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1512024-06-12T21:22:11.634ZINFOSledAgent (StorageManager): No ledger in /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-06-12T21:22:11.634ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:519
1532024-06-12T21:22:11.634ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:547
1542024-06-12T21:22:11.637ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3879
1552024-06-12T21:22:11.647ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
1562024-06-12T21:22:11.656ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
1572024-06-12T21:22:11.666ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
1582024-06-12T21:22:11.675ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
1592024-06-12T21:22:11.685ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
1602024-06-12T21:22:11.693ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
1612024-06-12T21:22:11.701ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
1622024-06-12T21:22:11.709ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
1632024-06-12T21:22:11.718ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:603 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
1642024-06-12T21:22:11.718ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:558
1652024-06-12T21:22:11.718ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:370
1662024-06-12T21:22:11.718ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
1672024-06-12T21:22:11.718ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:449 result = DisksManagementResult { status: [] }
1682024-06-12T21:22:11.718ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1692024-06-12T21:22:11.728ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:353 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
1702024-06-12T21:22:11.728ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
1712024-06-12T21:22:11.728ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:365 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
1722024-06-12T21:22:11.728ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1732024-06-12T21:22:11.731ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 144.410866ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "def379a6-7a3f-4365-817c-a659eeebaf03", "content-length": "124", "date": "Wed, 12 Jun 2024 21:22:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "def379a6-7a3f-4365-817c-a659eeebaf03" } file = clients/ddm-admin-client/src/lib.rs:178
1742024-06-12T21:22:11.739ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1752024-06-12T21:22:11.741ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_64bf9acf-c302-41ed-8452-f61f55d2f45f/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1762024-06-12T21:22:11.757ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1772024-06-12T21:22:11.764ZINFOSledAgent: successfully created encrypted zvol: name="oxi_64bf9acf-c302-41ed-8452-f61f55d2f45f/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1782024-06-12T21:22:11.764ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_64bf9acf-c302-41ed-8452-f61f55d2f45f/swap" file = sled-agent/src/swap_device.rs:96
1792024-06-12T21:22:11.769ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:380 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
1802024-06-12T21:22:11.769ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1812024-06-12T21:22:11.769ZINFOSledAgent (BackingFs): Ensuring dataset oxi_64bf9acf-c302-41ed-8452-f61f55d2f45f/backing/fmd file = sled-agent/src/backing_fs.rs:136
1822024-06-12T21:22:11.838ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1832024-06-12T21:22:11.879ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1842024-06-12T21:22:11.879ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 173.808094ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c94ed330-ad31-4d7b-a28b-60bc239509dc", "content-length": "124", "date": "Wed, 12 Jun 2024 21:22:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c94ed330-ad31-4d7b-a28b-60bc239509dc" } file = clients/ddm-admin-client/src/lib.rs:178
1852024-06-12T21:22:12.054ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1862024-06-12T21:22:12.055ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 98.423613ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "429ba44f-67d2-4a99-8ea3-d1f0e84ca3bf", "content-length": "124", "date": "Wed, 12 Jun 2024 21:22:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "429ba44f-67d2-4a99-8ea3-d1f0e84ca3bf" } file = clients/ddm-admin-client/src/lib.rs:178
1872024-06-12T21:22:12.058ZINFOSledAgent (BackingFs): Mounting oxi_64bf9acf-c302-41ed-8452-f61f55d2f45f/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1882024-06-12T21:22:12.072ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1892024-06-12T21:22:12.072ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1902024-06-12T21:22:12.072ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1912024-06-12T21:22:12.072ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1922024-06-12T21:22:12.154ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1932024-06-12T21:22:12.154ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 141.096332ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "14a250bf-248b-4a18-a98e-9aa27b87084e", "content-length": "124", "date": "Wed, 12 Jun 2024 21:22:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "14a250bf-248b-4a18-a98e-9aa27b87084e" } file = clients/ddm-admin-client/src/lib.rs:178
1942024-06-12T21:22:12.297ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1952024-06-12T21:22:12.298ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 289.242155ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "920824c5-e0f5-4ffc-b234-3d10d0885713", "content-length": "124", "date": "Wed, 12 Jun 2024 21:22:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "920824c5-e0f5-4ffc-b234-3d10d0885713" } file = clients/ddm-admin-client/src/lib.rs:178
1962024-06-12T21:22:12.588ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
1972024-06-12T21:22:12.589ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 342.664799ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9cd14604-a8c4-44d3-ad71-69fad9ccb1e0", "content-length": "124", "date": "Wed, 12 Jun 2024 21:22:11 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9cd14604-a8c4-44d3-ad71-69fad9ccb1e0" } file = clients/ddm-admin-client/src/lib.rs:178
1982024-06-12T21:22:12.769ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
1992024-06-12T21:22:12.770ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:33745 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2002024-06-12T21:22:12.770ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2012024-06-12T21:22:12.770ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:33745 file = oximeter/producer/src/lib.rs:276 interval = 30s producer_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2022024-06-12T21:22:12.771ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 237.37ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2032024-06-12T21:22:12.815ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2042024-06-12T21:22:12.815ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2052024-06-12T21:22:12.816ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:993 underlay_address = fd00:1122:3344:101::1
2062024-06-12T21:22:12.816ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2072024-06-12T21:22:12.816ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:12345
2082024-06-12T21:22:12.817ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
2092024-06-12T21:22:12.817ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2102024-06-12T21:22:12.817ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2112024-06-12T21:22:12.817ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2122024-06-12T21:22:12.817ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2132024-06-12T21:22:12.817ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:262 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2142024-06-12T21:22:12.817ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3647
2152024-06-12T21:22:12.817ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:57111
2162024-06-12T21:22:12.817ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2172024-06-12T21:22:12.817ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2182024-06-12T21:22:13.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2192024-06-12T21:22:13.019ZINFOSledAgent (RSS): No ledger in /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2202024-06-12T21:22:13.019ZINFOSledAgent (RSS): No ledger in /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2212024-06-12T21:22:13.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2222024-06-12T21:22:13.019ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2232024-06-12T21:22:13.020ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:164
2242024-06-12T21:22:13.021ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 469.484215ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2252024-06-12T21:22:13.025ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2262024-06-12T21:22:13.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57973
2272024-06-12T21:22:13.052ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2282024-06-12T21:22:13.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57973 req_id = 8c34ec46-a753-47c6-96a3-f62ccf105ad2 response_code = 200 uri = /inventory
2292024-06-12T21:22:13.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48271
2302024-06-12T21:22:13.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48271 req_id = 812ad28a-6a93-4604-b1fa-b14f154d5e78 response_code = 200 uri = /sled-role
2312024-06-12T21:22:13.083ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
2322024-06-12T21:22:13.083ZINFOSledAgent (RSS): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2332024-06-12T21:22:13.084ZINFOSledAgent (RSS): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2342024-06-12T21:22:13.084ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:815
2352024-06-12T21:22:13.114ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: 9e117e3f-62c7-4045-b191-7111badfe865, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, pool_id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool) }, OmicronPhysicalDiskConfig { id: 9187b87a-50ee-4d38-9881-5f5dd670218f, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, pool_id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool) }, OmicronPhysicalDiskConfig { id: da60b80b-6cbf-4f19-92df-361ea92a9e92, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, pool_id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool) }, OmicronPhysicalDiskConfig { id: de71d5fa-623d-45e7-8e74-d7a0c5d49327, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, pool_id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool) }, OmicronPhysicalDiskConfig { id: 362aa73c-f940-43d5-a686-8305066806e8, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, pool_id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool) }, OmicronPhysicalDiskConfig { id: 8f4019a6-ce7e-49b3-8b80-f047d5cc6803, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, pool_id: 1fdc26fb-b263-4c2f-8644-ca7d8d273b44 (zpool) }, OmicronPhysicalDiskConfig { id: fde65335-cefb-4027-b840-e3608f4578b6, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, pool_id: 23b2d7a5-435a-444f-8b3c-4170f8f73f40 (zpool) }, OmicronPhysicalDiskConfig { id: 88f12bd8-c310-42a6-95be-76a6cc641ffb, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, pool_id: 23f948a5-169f-4744-8cb4-c0ecf022e665 (zpool) }, OmicronPhysicalDiskConfig { id: 2af98a87-780f-4a9b-81bc-90c4f8545940, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, pool_id: 70df896f-091c-40a3-a0c4-31293f39c2cc (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:348 sled_address = [fd00:1122:3344:101::1]:12345
2362024-06-12T21:22:13.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56834
2372024-06-12T21:22:13.115ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9e117e3f-62c7-4045-b191-7111badfe865, pool_id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 9187b87a-50ee-4d38-9881-5f5dd670218f, pool_id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: da60b80b-6cbf-4f19-92df-361ea92a9e92, pool_id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: de71d5fa-623d-45e7-8e74-d7a0c5d49327, pool_id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 362aa73c-f940-43d5-a686-8305066806e8, pool_id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 8f4019a6-ce7e-49b3-8b80-f047d5cc6803, pool_id: 1fdc26fb-b263-4c2f-8644-ca7d8d273b44 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: fde65335-cefb-4027-b840-e3608f4578b6, pool_id: 23b2d7a5-435a-444f-8b3c-4170f8f73f40 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 88f12bd8-c310-42a6-95be-76a6cc641ffb, pool_id: 23f948a5-169f-4744-8cb4-c0ecf022e665 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 2af98a87-780f-4a9b-81bc-90c4f8545940, pool_id: 70df896f-091c-40a3-a0c4-31293f39c2cc (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:381
2382024-06-12T21:22:13.115ZINFOSledAgent (StorageManager): No ledger in /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2392024-06-12T21:22:13.115ZINFOSledAgent (StorageManager): No ledger in /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2402024-06-12T21:22:13.115ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:681 request = omicron_physical_disks_ensure
2412024-06-12T21:22:13.115ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:339
2422024-06-12T21:22:13.115ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:379
2432024-06-12T21:22:13.115ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2442024-06-12T21:22:13.115ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2452024-06-12T21:22:13.230ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:304
2462024-06-12T21:22:13.230ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool)
2472024-06-12T21:22:13.637ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.109267466s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2482024-06-12T21:22:13.891ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2492024-06-12T21:22:14.310ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }
2502024-06-12T21:22:14.508ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:332
2512024-06-12T21:22:14.508ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:334
2522024-06-12T21:22:14.508ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:338
2532024-06-12T21:22:14.508ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:340
2542024-06-12T21:22:14.508ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2552024-06-12T21:22:14.508ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2562024-06-12T21:22:14.508ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2572024-06-12T21:22:14.922ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.327557105s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2582024-06-12T21:22:14.922ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2592024-06-12T21:22:14.922ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2602024-06-12T21:22:14.938ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2612024-06-12T21:22:15.595ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2622024-06-12T21:22:15.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 65.704627ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2632024-06-12T21:22:15.814ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fdc5c351-bd0c-490e-a824-bb2f2b967954/crypt/zone file = sled-storage/src/dataset.rs:395
2642024-06-12T21:22:16.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 50.82928ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2652024-06-12T21:22:16.639ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2662024-06-12T21:22:16.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 163.381817ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2672024-06-12T21:22:17.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 305.960358ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2682024-06-12T21:22:17.265ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.22032317s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2692024-06-12T21:22:17.265ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2702024-06-12T21:22:17.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 461.19832ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2712024-06-12T21:22:17.835ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2722024-06-12T21:22:18.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.486466014s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2732024-06-12T21:22:18.901ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2742024-06-12T21:22:18.911ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fdc5c351-bd0c-490e-a824-bb2f2b967954 file = sled-storage/src/dataset.rs:480
2752024-06-12T21:22:19.107ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2762024-06-12T21:22:19.113ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:477
2772024-06-12T21:22:19.113ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:394
2782024-06-12T21:22:19.113ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:379
2792024-06-12T21:22:19.113ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
2802024-06-12T21:22:19.113ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2812024-06-12T21:22:19.345ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:304
2822024-06-12T21:22:19.345ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool)
2832024-06-12T21:22:20.445ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }
2842024-06-12T21:22:20.677ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:332
2852024-06-12T21:22:20.677ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:334
2862024-06-12T21:22:20.677ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:338
2872024-06-12T21:22:20.677ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:340
2882024-06-12T21:22:20.677ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2892024-06-12T21:22:20.677ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902024-06-12T21:22:20.677ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2912024-06-12T21:22:21.320ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2922024-06-12T21:22:21.320ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2932024-06-12T21:22:21.990ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942024-06-12T21:22:22.451ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_15994f92-33d0-4f72-971d-e91c145bfd50/crypt/zone file = sled-storage/src/dataset.rs:395
2952024-06-12T21:22:22.671ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.078656179s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:384 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2962024-06-12T21:22:22.671ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2972024-06-12T21:22:23.109ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2982024-06-12T21:22:23.111ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
2992024-06-12T21:22:23.228ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_15994f92-33d0-4f72-971d-e91c145bfd50 file = sled-storage/src/dataset.rs:480
3002024-06-12T21:22:23.237ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:477
3012024-06-12T21:22:23.237ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:394
3022024-06-12T21:22:23.237ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:379
3032024-06-12T21:22:23.237ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3042024-06-12T21:22:23.237ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3052024-06-12T21:22:23.246ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:304
3062024-06-12T21:22:23.246ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool)
3072024-06-12T21:22:23.344ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }
3082024-06-12T21:22:23.352ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:332
3092024-06-12T21:22:23.352ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3102024-06-12T21:22:23.352ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3112024-06-12T21:22:23.352ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3122024-06-12T21:22:23.352ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132024-06-12T21:22:23.352ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3142024-06-12T21:22:23.352ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3152024-06-12T21:22:23.388ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3162024-06-12T21:22:23.396ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a460ece5-fa75-4a2f-9cbe-a135dc5396ce/crypt/zone file = sled-storage/src/dataset.rs:395
3172024-06-12T21:22:23.518ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a460ece5-fa75-4a2f-9cbe-a135dc5396ce file = sled-storage/src/dataset.rs:480
3182024-06-12T21:22:23.526ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:477
3192024-06-12T21:22:23.526ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:394
3202024-06-12T21:22:23.526ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:379
3212024-06-12T21:22:23.526ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3222024-06-12T21:22:23.526ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232024-06-12T21:22:23.536ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:304
3242024-06-12T21:22:23.536ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool)
3252024-06-12T21:22:23.627ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External }
3262024-06-12T21:22:23.635ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:332
3272024-06-12T21:22:23.635ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:334
3282024-06-12T21:22:23.635ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:338
3292024-06-12T21:22:23.635ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:340
3302024-06-12T21:22:23.635ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-06-12T21:22:23.635ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322024-06-12T21:22:23.635ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3332024-06-12T21:22:23.669ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3342024-06-12T21:22:23.674ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
3352024-06-12T21:22:23.676ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_163451ca-17b3-4f83-ab53-55a998e6b8c3/crypt/zone file = sled-storage/src/dataset.rs:395
3362024-06-12T21:22:23.802ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_163451ca-17b3-4f83-ab53-55a998e6b8c3 file = sled-storage/src/dataset.rs:480
3372024-06-12T21:22:23.810ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:477
3382024-06-12T21:22:23.810ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:394
3392024-06-12T21:22:23.810ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:379
3402024-06-12T21:22:23.810ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3412024-06-12T21:22:23.810ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3422024-06-12T21:22:23.820ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:304
3432024-06-12T21:22:23.820ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool)
3442024-06-12T21:22:23.915ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External }
3452024-06-12T21:22:23.923ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:332
3462024-06-12T21:22:23.923ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:334
3472024-06-12T21:22:23.923ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:338
3482024-06-12T21:22:23.923ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:340
3492024-06-12T21:22:23.923ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502024-06-12T21:22:23.923ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3512024-06-12T21:22:23.923ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3522024-06-12T21:22:23.958ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3532024-06-12T21:22:23.966ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8043b355-0fd3-40fc-8db4-22fae40be7a4/crypt/zone file = sled-storage/src/dataset.rs:395
3542024-06-12T21:22:24.091ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8043b355-0fd3-40fc-8db4-22fae40be7a4 file = sled-storage/src/dataset.rs:480
3552024-06-12T21:22:24.099ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:477
3562024-06-12T21:22:24.099ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:394
3572024-06-12T21:22:24.099ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:379
3582024-06-12T21:22:24.099ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3592024-06-12T21:22:24.099ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3602024-06-12T21:22:24.109ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:304
3612024-06-12T21:22:24.109ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 1fdc26fb-b263-4c2f-8644-ca7d8d273b44 (zpool)
3622024-06-12T21:22:24.204ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 1fdc26fb-b263-4c2f-8644-ca7d8d273b44 (zpool), kind: External }
3632024-06-12T21:22:24.211ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:332
3642024-06-12T21:22:24.211ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:334
3652024-06-12T21:22:24.211ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:338
3662024-06-12T21:22:24.211ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:340
3672024-06-12T21:22:24.211ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682024-06-12T21:22:24.211ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3692024-06-12T21:22:24.211ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3702024-06-12T21:22:24.245ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3712024-06-12T21:22:24.252ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1fdc26fb-b263-4c2f-8644-ca7d8d273b44/crypt/zone file = sled-storage/src/dataset.rs:395
3722024-06-12T21:22:24.377ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1fdc26fb-b263-4c2f-8644-ca7d8d273b44 file = sled-storage/src/dataset.rs:480
3732024-06-12T21:22:24.386ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:477
3742024-06-12T21:22:24.386ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:394
3752024-06-12T21:22:24.386ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:379
3762024-06-12T21:22:24.386ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3772024-06-12T21:22:24.386ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3782024-06-12T21:22:24.397ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:304
3792024-06-12T21:22:24.397ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 23b2d7a5-435a-444f-8b3c-4170f8f73f40 (zpool)
3802024-06-12T21:22:24.491ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 23b2d7a5-435a-444f-8b3c-4170f8f73f40 (zpool), kind: External }
3812024-06-12T21:22:24.499ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:332
3822024-06-12T21:22:24.499ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:334
3832024-06-12T21:22:24.499ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:338
3842024-06-12T21:22:24.499ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:340
3852024-06-12T21:22:24.499ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862024-06-12T21:22:24.499ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872024-06-12T21:22:24.499ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3882024-06-12T21:22:24.535ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892024-06-12T21:22:24.542ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_23b2d7a5-435a-444f-8b3c-4170f8f73f40/crypt/zone file = sled-storage/src/dataset.rs:395
3902024-06-12T21:22:24.591ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2333
3912024-06-12T21:22:24.668ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_23b2d7a5-435a-444f-8b3c-4170f8f73f40 file = sled-storage/src/dataset.rs:480
3922024-06-12T21:22:24.676ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:477
3932024-06-12T21:22:24.676ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:394
3942024-06-12T21:22:24.676ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:379
3952024-06-12T21:22:24.676ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
3962024-06-12T21:22:24.676ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3972024-06-12T21:22:24.679ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
3982024-06-12T21:22:24.686ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:304
3992024-06-12T21:22:24.686ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 23f948a5-169f-4744-8cb4-c0ecf022e665 (zpool)
4002024-06-12T21:22:24.780ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 23f948a5-169f-4744-8cb4-c0ecf022e665 (zpool), kind: External }
4012024-06-12T21:22:24.787ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:332
4022024-06-12T21:22:24.787ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:334
4032024-06-12T21:22:24.787ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:338
4042024-06-12T21:22:24.787ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:340
4052024-06-12T21:22:24.787ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4062024-06-12T21:22:24.787ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4072024-06-12T21:22:24.787ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4082024-06-12T21:22:24.825ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4092024-06-12T21:22:24.833ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_23f948a5-169f-4744-8cb4-c0ecf022e665/crypt/zone file = sled-storage/src/dataset.rs:395
4102024-06-12T21:22:24.959ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_23f948a5-169f-4744-8cb4-c0ecf022e665 file = sled-storage/src/dataset.rs:480
4112024-06-12T21:22:24.967ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:477
4122024-06-12T21:22:24.967ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:394
4132024-06-12T21:22:24.967ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:379
4142024-06-12T21:22:24.967ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:456
4152024-06-12T21:22:24.967ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:121 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4162024-06-12T21:22:24.977ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:304
4172024-06-12T21:22:24.977ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:310 id = 70df896f-091c-40a3-a0c4-31293f39c2cc (zpool)
4182024-06-12T21:22:25.076ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 70df896f-091c-40a3-a0c4-31293f39c2cc (zpool), kind: External }
4192024-06-12T21:22:25.084ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:332
4202024-06-12T21:22:25.084ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:334
4212024-06-12T21:22:25.084ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:338
4222024-06-12T21:22:25.084ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:340
4232024-06-12T21:22:25.084ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242024-06-12T21:22:25.085ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4252024-06-12T21:22:25.085ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4262024-06-12T21:22:25.113ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
4272024-06-12T21:22:25.121ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4282024-06-12T21:22:25.128ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_70df896f-091c-40a3-a0c4-31293f39c2cc/crypt/zone file = sled-storage/src/dataset.rs:395
4292024-06-12T21:22:25.253ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_70df896f-091c-40a3-a0c4-31293f39c2cc file = sled-storage/src/dataset.rs:480
4302024-06-12T21:22:25.261ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:477
4312024-06-12T21:22:25.261ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:394
4322024-06-12T21:22:25.261ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332024-06-12T21:22:25.261ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024 }, zpool_name: ZpoolName { id: 64bf9acf-c302-41ed-8452-f61f55d2f45f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025 }, zpool_name: ZpoolName { id: e0099430-147d-4db6-a892-0d1b36d80310 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026 }, zpool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027 }, zpool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028 }, zpool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029 }, zpool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030 }, zpool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031 }, zpool_name: ZpoolName { id: 1fdc26fb-b263-4c2f-8644-ca7d8d273b44 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032 }, zpool_name: ZpoolName { id: 23b2d7a5-435a-444f-8b3c-4170f8f73f40 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033 }, zpool_name: ZpoolName { id: 23f948a5-169f-4744-8cb4-c0ecf022e665 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034 }, zpool_name: ZpoolName { id: 70df896f-091c-40a3-a0c4-31293f39c2cc (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4342024-06-12T21:22:25.261ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
4352024-06-12T21:22:25.261ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
4362024-06-12T21:22:25.262ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4372024-06-12T21:22:25.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 12147285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:56834 req_id = 43106fb5-ff2d-428d-a4a9-b75b70cc7eed response_code = 200 uri = /omicron-physical-disks
4382024-06-12T21:22:25.292ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 7a5079d1-e23b-479f-b97a-d95e79e68987, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a917873f-d73b-44e9-a1be-6517681cda1b, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
4392024-06-12T21:22:25.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62286
4402024-06-12T21:22:25.293ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7a5079d1-e23b-479f-b97a-d95e79e68987, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4412024-06-12T21:22:25.293ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7a5079d1-e23b-479f-b97a-d95e79e68987, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4422024-06-12T21:22:25.345ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4432024-06-12T21:22:25.345ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4442024-06-12T21:22:25.396ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a917873f-d73b-44e9-a1be-6517681cda1b, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
4452024-06-12T21:22:25.396ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a917873f-d73b-44e9-a1be-6517681cda1b, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: InternalDns }, responder: ... }
4462024-06-12T21:22:25.445ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4472024-06-12T21:22:25.445ZINFOSledAgent (ServiceManager): No ledger in /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/omicron-zones.json file = common/src/ledger.rs:188
4482024-06-12T21:22:25.445ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/omicron-zones.json file = common/src/ledger.rs:188
4492024-06-12T21:22:25.445ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4502024-06-12T21:22:25.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4512024-06-12T21:22:25.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4522024-06-12T21:22:25.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
4532024-06-12T21:22:25.540ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987 file = illumos-utils/src/zone.rs:315
4542024-06-12T21:22:25.544ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39 file = illumos-utils/src/zone.rs:315
4552024-06-12T21:22:25.548ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b file = illumos-utils/src/zone.rs:315
4562024-06-12T21:22:25.561ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987 file = illumos-utils/src/zone.rs:354
4572024-06-12T21:22:25.565ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39 file = illumos-utils/src/zone.rs:354
4582024-06-12T21:22:25.569ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b file = illumos-utils/src/zone.rs:354
4592024-06-12T21:22:25.681ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/3196594c-bc4a-474e-a0a2-7a0af521e0d4): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:169 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
4602024-06-12T21:22:27.033ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4612024-06-12T21:22:27.033ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:3::, len: 64 }
4622024-06-12T21:22:27.511ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4632024-06-12T21:22:27.511ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
4642024-06-12T21:22:27.515ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:2::, len: 64 }
4652024-06-12T21:22:27.994ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4662024-06-12T21:22:27.994ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
4672024-06-12T21:22:28.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b") failed: Property not found. retry in 64.841123ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
4682024-06-12T21:22:28.008ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:87 prefix = Ipv6Prefix { addr: fd00:1122:3344:1::, len: 64 }
4692024-06-12T21:22:28.008ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
4702024-06-12T21:22:28.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b") failed: Property not found. retry in 124.503932ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
4712024-06-12T21:22:28.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39") failed: Property not found. retry in 29.272674ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
4722024-06-12T21:22:28.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987") failed: Property not found. retry in 27.772652ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
4732024-06-12T21:22:28.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39") failed: Property not found. retry in 56.319664ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
4742024-06-12T21:22:28.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987") failed: Property not found. retry in 128.260716ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
4752024-06-12T21:22:28.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39") failed: Property not found. retry in 109.502446ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
4762024-06-12T21:22:28.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b") failed: Property not found. retry in 226.980686ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
4772024-06-12T21:22:28.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987") failed: Property not found. retry in 232.047315ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
4782024-06-12T21:22:28.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39") failed: Property not found. retry in 371.623843ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
4792024-06-12T21:22:28.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b") failed: Property not found. retry in 231.67723ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
4802024-06-12T21:22:28.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987") failed: Property not found. retry in 553.325925ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
4812024-06-12T21:22:28.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b") failed: Property not found. retry in 713.947546ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
4822024-06-12T21:22:28.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39") failed: Property not found. retry in 1.021986165s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
4832024-06-12T21:22:29.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987") failed: Property not found. retry in 977.898498ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
4842024-06-12T21:22:29.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b") failed: Property not found. retry in 1.24015098s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
4852024-06-12T21:22:30.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39") failed: Property not found. retry in 861.06119ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
4862024-06-12T21:22:30.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987") failed: Property not found. retry in 559.059723ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
4872024-06-12T21:22:30.660ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:a02a::2 exists in switch zone file = sled-agent/src/services.rs:2350
4882024-06-12T21:22:30.660ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4892024-06-12T21:22:30.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987") failed: Property not found. retry in 1.43655745s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
4902024-06-12T21:22:30.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39") failed: Property not found. retry in 1.106240196s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
4912024-06-12T21:22:30.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b") failed: Property not found. retry in 983.692122ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
4922024-06-12T21:22:31.204ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fe74:a16d file = sled-agent/src/services.rs:2357
4932024-06-12T21:22:31.209ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2418
4942024-06-12T21:22:31.328ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2603
4952024-06-12T21:22:31.577ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2767
4962024-06-12T21:22:31.770ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2482
4972024-06-12T21:22:31.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b") failed: Property not found. retry in 1.386289551s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
4982024-06-12T21:22:31.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39") failed: Property not found. retry in 570.228446ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
4992024-06-12T21:22:32.072ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2517
5002024-06-12T21:22:32.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987") failed: Property not found. retry in 1.349069771s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
5012024-06-12T21:22:32.289ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2817
5022024-06-12T21:22:32.471ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2844
5032024-06-12T21:22:32.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39") failed: Property not found. retry in 1.290483851s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
5042024-06-12T21:22:32.693ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2711
5052024-06-12T21:22:32.881ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2511
5062024-06-12T21:22:32.893ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3903 new = [fd00:1122:3344:101::2, ::1] old = [::1]
5072024-06-12T21:22:32.893ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3919
5082024-06-12T21:22:32.893ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
5092024-06-12T21:22:33.449ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3927
5102024-06-12T21:22:33.456ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3983
5112024-06-12T21:22:33.600ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4045
5122024-06-12T21:22:33.701ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4026 rack_subnet = fd00:1122:3344::
5132024-06-12T21:22:33.723ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4073
5142024-06-12T21:22:33.820ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4100
5152024-06-12T21:22:33.878ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_internal_dns_7a5079d1-e23b-479f-b97a-d95e79e68987
5162024-06-12T21:22:33.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_internal_dns_d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39
5172024-06-12T21:22:33.879ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_internal_dns_a917873f-d73b-44e9-a1be-6517681cda1b
5182024-06-12T21:22:33.879ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5192024-06-12T21:22:33.879ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5202024-06-12T21:22:33.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8586702 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62286 req_id = ea407832-8098-4bd8-9982-0af404fa8d39 response_code = 204 uri = /omicron-zones
5212024-06-12T21:22:33.881ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5222024-06-12T21:22:33.924ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 125.427985ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5232024-06-12T21:22:33.943ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:365
5242024-06-12T21:22:33.974ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:413
5252024-06-12T21:22:34.005ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:651
5262024-06-12T21:22:34.006ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:689
5272024-06-12T21:22:34.006ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:692 uptime = 3
5282024-06-12T21:22:34.006ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:435
5292024-06-12T21:22:34.070ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5302024-06-12T21:22:34.085ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:381
5312024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5322024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5332024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5342024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5352024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5362024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5372024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5382024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5392024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5402024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5412024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5422024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5432024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5442024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5452024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5462024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5472024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5482024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5492024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5502024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5512024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:532 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5522024-06-12T21:22:34.085ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:553 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5532024-06-12T21:22:34.121ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5542024-06-12T21:22:34.166ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:585
5552024-06-12T21:22:34.166ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5562024-06-12T21:22:34.196ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5572024-06-12T21:22:34.197ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5582024-06-12T21:22:34.197ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5592024-06-12T21:22:34.225ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 7a5079d1-e23b-479f-b97a-d95e79e68987, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a917873f-d73b-44e9-a1be-6517681cda1b, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a4a27f80-0a38-4a73-8ef3-0f38e00a4c59, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 562d8177-d709-4e90-a32d-6bdd5710847e, kind: Service { id: a4a27f80-0a38-4a73-8ef3-0f38e00a4c59 }, name: Name("ntp-a4a27f80-0a38-4a73-8ef3-0f38e00a4c59"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 201])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
5602024-06-12T21:22:34.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45756
5612024-06-12T21:22:34.227ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7a5079d1-e23b-479f-b97a-d95e79e68987, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5622024-06-12T21:22:34.227ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7a5079d1-e23b-479f-b97a-d95e79e68987, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5632024-06-12T21:22:34.249ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5642024-06-12T21:22:34.249ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5652024-06-12T21:22:34.267ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a917873f-d73b-44e9-a1be-6517681cda1b, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
5662024-06-12T21:22:34.267ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a917873f-d73b-44e9-a1be-6517681cda1b, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: InternalDns }, responder: ... }
5672024-06-12T21:22:34.285ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5682024-06-12T21:22:34.285ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/omicron-zones.json file = common/src/ledger.rs:177
5692024-06-12T21:22:34.285ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/omicron-zones.json file = common/src/ledger.rs:177
5702024-06-12T21:22:34.285ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5712024-06-12T21:22:34.296ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
5722024-06-12T21:22:34.328ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
5732024-06-12T21:22:34.329ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
5742024-06-12T21:22:34.329ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
5752024-06-12T21:22:34.372ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 210, 201]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" } }
5762024-06-12T21:22:34.372ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = ntp
5772024-06-12T21:22:34.373ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
5782024-06-12T21:22:34.373ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
5792024-06-12T21:22:34.373ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.169, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
5802024-06-12T21:22:34.374ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
5812024-06-12T21:22:34.397ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59 file = illumos-utils/src/zone.rs:315
5822024-06-12T21:22:34.413ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59 file = illumos-utils/src/zone.rs:354
5832024-06-12T21:22:35.033ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5842024-06-12T21:22:35.033ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5852024-06-12T21:22:35.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59") failed: Property not found. retry in 42.667113ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5862024-06-12T21:22:35.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59") failed: Property not found. retry in 108.505001ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5872024-06-12T21:22:35.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59") failed: Property not found. retry in 230.771615ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5882024-06-12T21:22:35.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59") failed: Property not found. retry in 469.623171ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5892024-06-12T21:22:36.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59") failed: Property not found. retry in 609.441502ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5902024-06-12T21:22:36.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59") failed: Property not found. retry in 1.381720603s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5912024-06-12T21:22:37.365ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48202
5922024-06-12T21:22:37.365ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48202 req_id = d09e0465-5f42-4c49-8e26-d44f7657aeaa response_code = 200 uri = /baseboard
5932024-06-12T21:22:38.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59") failed: Property not found. retry in 788.161469ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5942024-06-12T21:22:38.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59") failed: Property not found. retry in 1.466220429s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5952024-06-12T21:22:40.377ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59
5962024-06-12T21:22:40.377ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5972024-06-12T21:22:40.378ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5982024-06-12T21:22:40.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6152316 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45756 req_id = f7fe9996-00b8-4bd7-908e-c405267e7e57 response_code = 204 uri = /omicron-zones
5992024-06-12T21:22:40.380ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:626
6002024-06-12T21:22:40.410ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6012024-06-12T21:22:40.410ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46531
6022024-06-12T21:22:40.418ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3633
6032024-06-12T21:22:40.418ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 8575 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46531 req_id = 304c2945-b67d-4253-ae2f-4b386054c7ce response_code = 500 uri = /timesync
6042024-06-12T21:22:40.421ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6052024-06-12T21:22:40.529ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6062024-06-12T21:22:40.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48756
6072024-06-12T21:22:44.536ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3633
6082024-06-12T21:22:44.537ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4007733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48756 req_id = f3359318-63ad-4d00-8f4d-4e6df8612989 response_code = 500 uri = /timesync
6092024-06-12T21:22:44.540ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6102024-06-12T21:22:44.642ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6112024-06-12T21:22:44.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57429
6122024-06-12T21:22:44.650ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3633
6132024-06-12T21:22:44.651ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 8582 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57429 req_id = c60c79f8-2504-4800-af0b-b52f43923595 response_code = 500 uri = /timesync
6142024-06-12T21:22:44.654ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6152024-06-12T21:22:44.840ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6162024-06-12T21:22:44.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42742
6172024-06-12T21:22:48.849ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_a4a27f80-0a38-4a73-8ef3-0f38e00a4c59': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3633
6182024-06-12T21:22:48.849ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4008803 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42742 req_id = 8c686b12-9142-4a0d-9559-ed0923e01b3d response_code = 500 uri = /timesync
6192024-06-12T21:22:48.852ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6202024-06-12T21:22:49.132ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6212024-06-12T21:22:49.132ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55913
6222024-06-12T21:22:49.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55913 req_id = 6e580d5b-36c8-4ed5-8226-8959c08c0889 response_code = 200 uri = /timesync
6232024-06-12T21:22:49.142ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6242024-06-12T21:22:49.142ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6252024-06-12T21:22:49.291ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6262024-06-12T21:22:49.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54629
6272024-06-12T21:22:49.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7414 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54629 req_id = 070b664d-6d08-4e96-8999-10443921f764 response_code = 200 uri = /timesync
6282024-06-12T21:22:49.301ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6292024-06-12T21:22:49.301ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6302024-06-12T21:22:49.679ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6312024-06-12T21:22:49.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41623
6322024-06-12T21:22:49.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7832 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41623 req_id = ec452e24-84f0-4678-8cda-ad61e506965b response_code = 200 uri = /timesync
6332024-06-12T21:22:49.688ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6342024-06-12T21:22:49.688ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6352024-06-12T21:22:50.018ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6362024-06-12T21:22:50.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51558
6372024-06-12T21:22:50.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8348 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51558 req_id = 33d25019-b885-434f-91ab-0fb19c21194b response_code = 200 uri = /timesync
6382024-06-12T21:22:50.029ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6392024-06-12T21:22:50.029ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6402024-06-12T21:22:50.421ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6412024-06-12T21:22:50.421ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40590
6422024-06-12T21:22:50.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7529 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40590 req_id = 52ddc8ef-1ec2-4578-a2bc-742e749ccbaa response_code = 200 uri = /timesync
6432024-06-12T21:22:50.431ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6442024-06-12T21:22:50.431ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6452024-06-12T21:22:50.788ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 363.637439ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
6462024-06-12T21:22:50.865ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6472024-06-12T21:22:50.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37835
6482024-06-12T21:22:50.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8453 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37835 req_id = 69b4ffa5-3e33-460a-be30-5e8d6deb2d8d response_code = 200 uri = /timesync
6492024-06-12T21:22:50.877ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6502024-06-12T21:22:50.877ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6512024-06-12T21:22:52.074ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6522024-06-12T21:22:52.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49596
6532024-06-12T21:22:52.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7948 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49596 req_id = bcad6cc0-a1b3-4bf5-8350-2c3e0aae5f23 response_code = 200 uri = /timesync
6542024-06-12T21:22:52.084ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6552024-06-12T21:22:52.084ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6562024-06-12T21:22:52.537ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6572024-06-12T21:22:52.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61616
6582024-06-12T21:22:52.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8010 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61616 req_id = 9f2f6772-bb31-4bfe-9c35-45d76012565b response_code = 200 uri = /timesync
6592024-06-12T21:22:52.547ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6602024-06-12T21:22:52.547ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6612024-06-12T21:22:52.952ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6622024-06-12T21:22:52.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44882
6632024-06-12T21:22:52.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7605 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44882 req_id = 604e3244-a3e0-4fb9-bb1b-046fd51a2002 response_code = 200 uri = /timesync
6642024-06-12T21:22:52.962ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6652024-06-12T21:22:52.962ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6662024-06-12T21:22:54.239ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6672024-06-12T21:22:54.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50720
6682024-06-12T21:22:54.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7790 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50720 req_id = 64db3e0e-6d30-4ccc-b518-583566a808af response_code = 200 uri = /timesync
6692024-06-12T21:22:54.249ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6702024-06-12T21:22:54.249ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6712024-06-12T21:22:55.294ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6722024-06-12T21:22:55.294ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50540
6732024-06-12T21:22:55.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8505 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50540 req_id = 533b17ab-bdf5-4014-9603-fdb9d441a664 response_code = 200 uri = /timesync
6742024-06-12T21:22:55.305ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6752024-06-12T21:22:55.305ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6762024-06-12T21:22:56.369ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6772024-06-12T21:22:56.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48220
6782024-06-12T21:22:56.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8465 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48220 req_id = c3bf03e3-9dfb-4198-9e89-bdc9b0e4ab10 response_code = 200 uri = /timesync
6792024-06-12T21:22:56.380ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6802024-06-12T21:22:56.380ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6812024-06-12T21:22:57.493ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6822024-06-12T21:22:57.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46054
6832024-06-12T21:22:57.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8410 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46054 req_id = 4c33fb06-4b76-4494-aa60-7db711da5cb7 response_code = 200 uri = /timesync
6842024-06-12T21:22:57.503ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6852024-06-12T21:22:57.503ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6862024-06-12T21:22:59.148ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6872024-06-12T21:22:59.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43522
6882024-06-12T21:22:59.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8066 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43522 req_id = 0a8a2fe6-e8b2-4f44-9d6c-d6c598be503c response_code = 200 uri = /timesync
6892024-06-12T21:22:59.160ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6902024-06-12T21:22:59.160ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6912024-06-12T21:23:00.466ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6922024-06-12T21:23:00.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52375
6932024-06-12T21:23:00.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8595 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52375 req_id = 952d6b40-f51b-49bc-a02c-443929c35231 response_code = 200 uri = /timesync
6942024-06-12T21:23:00.477ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6952024-06-12T21:23:00.477ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6962024-06-12T21:23:02.518ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6972024-06-12T21:23:02.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56344
6982024-06-12T21:23:02.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56344 req_id = 5cda7e88-1a80-4085-8fce-1f407452042d response_code = 200 uri = /timesync
6992024-06-12T21:23:02.529ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7002024-06-12T21:23:02.529ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7012024-06-12T21:23:06.734ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7022024-06-12T21:23:06.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46661
7032024-06-12T21:23:06.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46661 req_id = 4ff10055-edd5-4367-bde6-bd274820a809 response_code = 200 uri = /timesync
7042024-06-12T21:23:06.745ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7052024-06-12T21:23:06.745ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7062024-06-12T21:23:06.961ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 373.157311ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
7072024-06-12T21:23:08.171ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40258
7082024-06-12T21:23:08.171ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40258 req_id = 262c3f46-c390-4148-8f05-a6e3dfee0830 response_code = 200 uri = /baseboard
7092024-06-12T21:23:11.238ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7102024-06-12T21:23:11.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58277
7112024-06-12T21:23:11.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8626 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58277 req_id = 0ef50ac2-79a5-4090-9e1b-ffa1727ccbf2 response_code = 200 uri = /timesync
7122024-06-12T21:23:11.249ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7132024-06-12T21:23:11.249ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7142024-06-12T21:23:15.151ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7152024-06-12T21:23:15.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63301
7162024-06-12T21:23:15.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 10063 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63301 req_id = 4bfb6831-a370-4b31-9905-b7c6df444ed5 response_code = 200 uri = /timesync
7172024-06-12T21:23:15.164ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7182024-06-12T21:23:15.164ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7192024-06-12T21:23:19.231ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7202024-06-12T21:23:19.231ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32961
7212024-06-12T21:23:19.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:32961 req_id = e7f0e974-cf08-4a0e-a168-a1e7f545b41b response_code = 200 uri = /timesync
7222024-06-12T21:23:19.243ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7232024-06-12T21:23:19.243ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7242024-06-12T21:23:22.368ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 981.022382ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
7252024-06-12T21:23:24.429ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7262024-06-12T21:23:24.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52089
7272024-06-12T21:23:24.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52089 req_id = 7dea5198-a7aa-4bd1-bf8e-5ed8ed63ac7e response_code = 200 uri = /timesync
7282024-06-12T21:23:24.440ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7292024-06-12T21:23:24.440ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7302024-06-12T21:23:29.196ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7312024-06-12T21:23:29.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56152
7322024-06-12T21:23:29.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8622 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56152 req_id = a27d4f27-7049-4887-b6aa-4884bbc8e7a2 response_code = 200 uri = /timesync
7332024-06-12T21:23:29.207ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7342024-06-12T21:23:29.207ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7352024-06-12T21:23:38.205ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62465
7362024-06-12T21:23:38.206ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62465 req_id = ff470975-af09-446c-856e-eeb57c0a30ee response_code = 200 uri = /baseboard
7372024-06-12T21:23:38.383ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.044888889s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
7382024-06-12T21:23:38.860ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7392024-06-12T21:23:38.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34580
7402024-06-12T21:23:38.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7946 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34580 req_id = b7e4cab6-d47c-40b4-af26-c0bbdc8049b3 response_code = 200 uri = /timesync
7412024-06-12T21:23:38.871ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7422024-06-12T21:23:38.871ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7432024-06-12T21:23:55.462ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.963119657s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
7442024-06-12T21:23:56.045ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7452024-06-12T21:23:56.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55559
7462024-06-12T21:23:56.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55559 req_id = 542e0360-3273-4945-a556-28f20cf317a2 response_code = 200 uri = /timesync
7472024-06-12T21:23:56.056ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
7482024-06-12T21:23:56.056ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7492024-06-12T21:24:08.213ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43527
7502024-06-12T21:24:08.213ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43527 req_id = 0b280a09-fe00-4801-956e-e0e3161953b2 response_code = 200 uri = /baseboard
7512024-06-12T21:24:15.413ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.914059103s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
7522024-06-12T21:24:16.580ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7532024-06-12T21:24:16.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37307
7542024-06-12T21:24:16.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8470 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37307 req_id = 6a770ce7-e722-4ac1-9229-623dbe36fdf2 response_code = 200 uri = /timesync
7552024-06-12T21:24:16.591ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.396798074 } file = sled-agent/src/rack_setup/service.rs:634
7562024-06-12T21:24:16.591ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7572024-06-12T21:24:27.786ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7582024-06-12T21:24:27.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55447
7592024-06-12T21:24:27.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55447 req_id = 16ba4a56-902d-4d43-b0b9-ebfb4684d077 response_code = 200 uri = /timesync
7602024-06-12T21:24:27.797ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.366467297 } file = sled-agent/src/rack_setup/service.rs:634
7612024-06-12T21:24:27.797ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7622024-06-12T21:24:37.786ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7632024-06-12T21:24:37.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65408
7642024-06-12T21:24:37.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8077 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65408 req_id = adaace90-76e1-4a01-b594-1b36849674c5 response_code = 200 uri = /timesync
7652024-06-12T21:24:37.798ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.339310706 } file = sled-agent/src/rack_setup/service.rs:634
7662024-06-12T21:24:37.798ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7672024-06-12T21:24:38.164ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36339
7682024-06-12T21:24:38.164ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 55 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36339 req_id = cb704471-f517-44fc-8413-e58e1d1a1827 response_code = 200 uri = /baseboard
7692024-06-12T21:24:39.297ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.735389414s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
7702024-06-12T21:25:01.914ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7712024-06-12T21:25:01.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44550
7722024-06-12T21:25:01.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7632 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44550 req_id = 019c54a2-7332-41ae-a91b-21cf6d95d455 response_code = 200 uri = /timesync
7732024-06-12T21:25:01.924ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.273786753 } file = sled-agent/src/rack_setup/service.rs:634
7742024-06-12T21:25:01.924ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7752024-06-12T21:25:04.997ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 36.974797228s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
7762024-06-12T21:25:08.115ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56135
7772024-06-12T21:25:08.115ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56135 req_id = ceeaaaf4-98ef-46a5-bd2a-207cf7533e06 response_code = 200 uri = /baseboard
7782024-06-12T21:25:24.154ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7792024-06-12T21:25:24.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34326
7802024-06-12T21:25:24.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8943 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34326 req_id = d9e5f85e-4f59-4678-8cc1-a59e94ae23af response_code = 200 uri = /timesync
7812024-06-12T21:25:24.165ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 760180647, ip_addr: 45.79.111.167, stratum: 3, ref_time: 1718227517.5036843, correction: -0.214406893 } file = sled-agent/src/rack_setup/service.rs:634
7822024-06-12T21:25:24.165ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7832024-06-12T21:25:38.065ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39801
7842024-06-12T21:25:38.065ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39801 req_id = 7d8068e0-6879-4323-b88e-572325c84435 response_code = 200 uri = /baseboard
7852024-06-12T21:25:56.864ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 61.763514305s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
7862024-06-12T21:26:03.111ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7872024-06-12T21:26:03.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43498
7882024-06-12T21:26:03.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8715 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43498 req_id = 6f0ad2b4-f48a-4d19-84e9-7c56004840a9 response_code = 200 uri = /timesync
7892024-06-12T21:26:03.122ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 760180647, ip_addr: 45.79.111.167, stratum: 3, ref_time: 1718227517.5036843, correction: -0.10861285 } file = sled-agent/src/rack_setup/service.rs:634
7902024-06-12T21:26:03.122ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
7912024-06-12T21:26:08.015ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48071
7922024-06-12T21:26:08.015ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48071 req_id = b0e47295-ce71-495d-91e7-97a1c59d0f91 response_code = 200 uri = /baseboard
7932024-06-12T21:26:32.233ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
7942024-06-12T21:26:32.233ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60103
7952024-06-12T21:26:32.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 20338 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60103 req_id = 2dcbe681-eb05-4aff-903b-086e05c3b186 response_code = 200 uri = /timesync
7962024-06-12T21:26:32.256ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 3325826800, ip_addr: 198.60.22.240, stratum: 2, ref_time: 1718227566.0229857, correction: -0.028321749 } file = sled-agent/src/rack_setup/service.rs:634
7972024-06-12T21:26:32.256ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1224
7982024-06-12T21:26:32.284ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 7a5079d1-e23b-479f-b97a-d95e79e68987, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a917873f-d73b-44e9-a1be-6517681cda1b, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a4a27f80-0a38-4a73-8ef3-0f38e00a4c59, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 562d8177-d709-4e90-a32d-6bdd5710847e, kind: Service { id: a4a27f80-0a38-4a73-8ef3-0f38e00a4c59 }, name: Name("ntp-a4a27f80-0a38-4a73-8ef3-0f38e00a4c59"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 201])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 07357eaf-0fd5-41ef-84e7-5b6afa791785, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9cbd4d02-bfd3-4c3e-80f4-d87add71e87e, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External } } } }, OmicronZoneConfig { id: 56ae27de-50df-47a7-8319-127824288379, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External } } } }, OmicronZoneConfig { id: 96206cb9-5198-49b4-8622-38209f52b88a, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 31a3b42f-4724-4394-a99b-682858677628, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
7992024-06-12T21:26:32.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49918
8002024-06-12T21:26:32.285ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7a5079d1-e23b-479f-b97a-d95e79e68987, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8012024-06-12T21:26:32.285ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7a5079d1-e23b-479f-b97a-d95e79e68987, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8022024-06-12T21:26:32.305ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8032024-06-12T21:26:32.305ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8042024-06-12T21:26:32.324ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a917873f-d73b-44e9-a1be-6517681cda1b, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
8052024-06-12T21:26:32.324ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a917873f-d73b-44e9-a1be-6517681cda1b, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: InternalDns }, responder: ... }
8062024-06-12T21:26:32.342ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 07357eaf-0fd5-41ef-84e7-5b6afa791785, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8072024-06-12T21:26:32.342ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 07357eaf-0fd5-41ef-84e7-5b6afa791785, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8082024-06-12T21:26:32.395ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9cbd4d02-bfd3-4c3e-80f4-d87add71e87e, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8092024-06-12T21:26:32.395ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9cbd4d02-bfd3-4c3e-80f4-d87add71e87e, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8102024-06-12T21:26:32.449ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 56ae27de-50df-47a7-8319-127824288379, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8112024-06-12T21:26:32.449ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 56ae27de-50df-47a7-8319-127824288379, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8122024-06-12T21:26:32.501ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 96206cb9-5198-49b4-8622-38209f52b88a, dataset_name: DatasetName { pool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8132024-06-12T21:26:32.501ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 96206cb9-5198-49b4-8622-38209f52b88a, dataset_name: DatasetName { pool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8142024-06-12T21:26:32.553ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 31a3b42f-4724-4394-a99b-682858677628, dataset_name: DatasetName { pool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
8152024-06-12T21:26:32.553ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 31a3b42f-4724-4394-a99b-682858677628, dataset_name: DatasetName { pool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8162024-06-12T21:26:32.604ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8172024-06-12T21:26:32.604ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/omicron-zones.json file = common/src/ledger.rs:177
8182024-06-12T21:26:32.605ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/omicron-zones.json file = common/src/ledger.rs:177
8192024-06-12T21:26:32.605ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8202024-06-12T21:26:32.688ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8212024-06-12T21:26:32.688ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8222024-06-12T21:26:32.688ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8232024-06-12T21:26:32.688ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8242024-06-12T21:26:32.688ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
8252024-06-12T21:26:32.776ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628 file = illumos-utils/src/zone.rs:315
8262024-06-12T21:26:32.780ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a file = illumos-utils/src/zone.rs:315
8272024-06-12T21:26:32.784ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379 file = illumos-utils/src/zone.rs:315
8282024-06-12T21:26:32.788ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785 file = illumos-utils/src/zone.rs:315
8292024-06-12T21:26:32.793ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e file = illumos-utils/src/zone.rs:315
8302024-06-12T21:26:32.797ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628 file = illumos-utils/src/zone.rs:354
8312024-06-12T21:26:32.802ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a file = illumos-utils/src/zone.rs:354
8322024-06-12T21:26:32.806ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379 file = illumos-utils/src/zone.rs:354
8332024-06-12T21:26:32.811ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785 file = illumos-utils/src/zone.rs:354
8342024-06-12T21:26:32.815ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e file = illumos-utils/src/zone.rs:354
8352024-06-12T21:26:35.742ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="07357eaf-0fd5-41ef-84e7-5b6afa791785"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::3]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8362024-06-12T21:26:35.742ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8372024-06-12T21:26:35.748ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="96206cb9-5198-49b4-8622-38209f52b88a"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::6]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8382024-06-12T21:26:35.748ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8392024-06-12T21:26:35.756ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="9cbd4d02-bfd3-4c3e-80f4-d87add71e87e"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::4]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8402024-06-12T21:26:35.756ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8412024-06-12T21:26:35.763ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="56ae27de-50df-47a7-8319-127824288379"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::5]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8422024-06-12T21:26:35.764ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8432024-06-12T21:26:35.769ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="31a3b42f-4724-4394-a99b-682858677628"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::7]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8442024-06-12T21:26:35.770ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8452024-06-12T21:26:35.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 73.780004ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8462024-06-12T21:26:35.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 42.090425ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8472024-06-12T21:26:35.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 62.228223ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8482024-06-12T21:26:35.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 37.044859ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8492024-06-12T21:26:35.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 53.149965ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8502024-06-12T21:26:35.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 103.084363ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8512024-06-12T21:26:35.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 68.215572ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8522024-06-12T21:26:36.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 128.111111ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8532024-06-12T21:26:36.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 135.681239ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8542024-06-12T21:26:36.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 74.796667ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8552024-06-12T21:26:37.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 212.435778ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8562024-06-12T21:26:37.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 127.294852ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8572024-06-12T21:26:37.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 220.111754ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8582024-06-12T21:26:37.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 114.102694ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8592024-06-12T21:26:37.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 284.067767ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8602024-06-12T21:26:37.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 483.778914ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8612024-06-12T21:26:37.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 473.08846ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8622024-06-12T21:26:37.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 438.598845ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8632024-06-12T21:26:38.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 319.994495ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8642024-06-12T21:26:38.005ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63599
8652024-06-12T21:26:38.005ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 169 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63599 req_id = ee5f137b-32ef-491a-97f9-64ffc226a60e response_code = 200 uri = /baseboard
8662024-06-12T21:26:38.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 338.844134ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8672024-06-12T21:26:38.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 535.252898ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8682024-06-12T21:26:38.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 661.251336ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8692024-06-12T21:26:38.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 443.7817ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8702024-06-12T21:26:38.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 716.3115ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8712024-06-12T21:26:38.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 754.769334ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8722024-06-12T21:26:38.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 814.148302ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8732024-06-12T21:26:38.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 717.257517ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8742024-06-12T21:26:39.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 647.562373ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8752024-06-12T21:26:39.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 1.096448507s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8762024-06-12T21:26:39.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 1.370043793s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8772024-06-12T21:26:39.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 591.376273ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8782024-06-12T21:26:39.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 715.027084ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8792024-06-12T21:26:39.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 511.348502ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8802024-06-12T21:26:40.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 634.661701ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8812024-06-12T21:26:40.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 1.174874438s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8822024-06-12T21:26:40.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 1.050153073s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8832024-06-12T21:26:40.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 1.28859371s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8842024-06-12T21:26:40.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 1.345234757s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8852024-06-12T21:26:40.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 1.186625346s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8862024-06-12T21:26:41.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 972.674012ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8872024-06-12T21:26:41.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 903.340876ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8882024-06-12T21:26:41.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 719.980443ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8892024-06-12T21:26:42.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 905.12369ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8902024-06-12T21:26:42.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 1.335145285s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8912024-06-12T21:26:42.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 855.614322ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8922024-06-12T21:26:42.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 1.150905371s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8932024-06-12T21:26:42.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 1.366835848s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
8942024-06-12T21:26:42.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 624.030623ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8952024-06-12T21:26:43.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 760.110939ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
8962024-06-12T21:26:43.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 758.09247ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
8972024-06-12T21:26:43.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 834.406132ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
8982024-06-12T21:26:43.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a") failed: Property not found. retry in 948.129094ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
8992024-06-12T21:26:43.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 1.408265829s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9002024-06-12T21:26:44.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e") failed: Property not found. retry in 578.538217ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
9012024-06-12T21:26:44.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 1.236079096s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9022024-06-12T21:26:44.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 622.49606ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9032024-06-12T21:26:45.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 1.488631812s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9042024-06-12T21:26:45.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 767.713027ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9052024-06-12T21:26:45.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 855.93011ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9062024-06-12T21:26:46.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 1.339954447s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9072024-06-12T21:26:46.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 955.488319ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9082024-06-12T21:26:46.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 1.385590679s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9092024-06-12T21:26:47.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 711.694393ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9102024-06-12T21:26:47.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 1.489841353s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9112024-06-12T21:26:47.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 1.069084151s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9122024-06-12T21:26:48.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 620.774425ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9132024-06-12T21:26:48.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 849.418586ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9142024-06-12T21:26:48.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 526.513996ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9152024-06-12T21:26:49.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 1.013683768s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9162024-06-12T21:26:49.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 773.970841ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9172024-06-12T21:26:49.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 914.916313ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9182024-06-12T21:26:50.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 657.490318ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9192024-06-12T21:26:50.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 580.307857ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9202024-06-12T21:26:50.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 1.04039951s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9212024-06-12T21:26:50.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 707.264186ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9222024-06-12T21:26:50.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 1.026342014s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9232024-06-12T21:26:51.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 824.041944ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9242024-06-12T21:26:51.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 674.622423ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9252024-06-12T21:26:51.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 1.458145675s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9262024-06-12T21:26:52.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 1.435844597s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9272024-06-12T21:26:52.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 1.354083842s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9282024-06-12T21:26:53.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785") failed: Property not found. retry in 1.451309301s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9292024-06-12T21:26:53.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628") failed: Property not found. retry in 630.687031ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9302024-06-12T21:26:53.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379") failed: Property not found. retry in 1.125272459s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9312024-06-12T21:26:54.883ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_cockroachdb_31a3b42f-4724-4394-a99b-682858677628
9322024-06-12T21:26:54.883ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_cockroachdb_96206cb9-5198-49b4-8622-38209f52b88a
9332024-06-12T21:26:54.883ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_cockroachdb_56ae27de-50df-47a7-8319-127824288379
9342024-06-12T21:26:54.883ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785
9352024-06-12T21:26:54.883ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_cockroachdb_9cbd4d02-bfd3-4c3e-80f4-d87add71e87e
9362024-06-12T21:26:54.883ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9372024-06-12T21:26:54.884ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
9382024-06-12T21:26:54.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 22628933 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:49918 req_id = 272ea7b4-6514-4053-9630-e5bc99e8af78 response_code = 204 uri = /omicron-zones
9392024-06-12T21:26:54.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42794
9402024-06-12T21:26:54.952ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 34087 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:42794 req_id = 733c8af2-f2f3-44df-b0fb-959ba70956e6 response_code = 500 uri = /cockroachdb
9412024-06-12T21:26:54.953ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "733c8af2-f2f3-44df-b0fb-959ba70956e6", "content-length": "124", "date": "Wed, 12 Jun 2024 21:26:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "733c8af2-f2f3-44df-b0fb-959ba70956e6" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 134.454695ms
9422024-06-12T21:26:55.117ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27794 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:42794 req_id = 6f41a57f-6597-4010-b7fb-a5311d1f1c6b response_code = 500 uri = /cockroachdb
9432024-06-12T21:26:55.117ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6f41a57f-6597-4010-b7fb-a5311d1f1c6b", "content-length": "124", "date": "Wed, 12 Jun 2024 21:26:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6f41a57f-6597-4010-b7fb-a5311d1f1c6b" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 125.640042ms
9442024-06-12T21:26:55.270ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_07357eaf-0fd5-41ef-84e7-5b6afa791785 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 25644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:42794 req_id = 513c6882-4783-4530-b12a-c5fd9bddece0 response_code = 500 uri = /cockroachdb
9452024-06-12T21:26:55.270ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "513c6882-4783-4530-b12a-c5fd9bddece0", "content-length": "124", "date": "Wed, 12 Jun 2024 21:26:54 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "513c6882-4783-4530-b12a-c5fd9bddece0" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 188.862623ms
9462024-06-12T21:26:55.486ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3467
9472024-06-12T21:27:07.927ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3485
9482024-06-12T21:27:17.662ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3508
9492024-06-12T21:27:17.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 22202498 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:42794 req_id = a75991ee-9e7d-4a62-be43-64281873b234 response_code = 204 uri = /cockroachdb
9502024-06-12T21:27:17.663ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46103
9512024-06-12T21:27:17.664ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 345 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46103 req_id = 8fd2fbcf-eb5a-4cf2-938b-02069d612868 response_code = 200 uri = /baseboard
9522024-06-12T21:27:17.705ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 7a5079d1-e23b-479f-b97a-d95e79e68987, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: a917873f-d73b-44e9-a1be-6517681cda1b, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: a4a27f80-0a38-4a73-8ef3-0f38e00a4c59, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 562d8177-d709-4e90-a32d-6bdd5710847e, kind: Service { id: a4a27f80-0a38-4a73-8ef3-0f38e00a4c59 }, name: Name("ntp-a4a27f80-0a38-4a73-8ef3-0f38e00a4c59"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 201])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 07357eaf-0fd5-41ef-84e7-5b6afa791785, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9cbd4d02-bfd3-4c3e-80f4-d87add71e87e, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External } } } }, OmicronZoneConfig { id: 56ae27de-50df-47a7-8319-127824288379, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External } } } }, OmicronZoneConfig { id: 96206cb9-5198-49b4-8622-38209f52b88a, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 31a3b42f-4724-4394-a99b-682858677628, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: b0f3f370-9025-4e91-be90-414e2843437b, kind: Service { id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf }, name: Name("external-dns-2104361f-f28a-4d05-9bef-d2bf9cc7accf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: c848ab67-c488-4921-ac9a-d662e7f440af, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: ba8d2a2b-5248-4f73-bcdc-4bb653022a9a, kind: Service { id: c848ab67-c488-4921-ac9a-d662e7f440af }, name: Name("external-dns-c848ab67-c488-4921-ac9a-d662e7f440af"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 } } }, OmicronZoneConfig { id: 3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 28dc4374-c469-46f9-a3ff-03ae425af71b, kind: Service { id: 3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 }, name: Name("nexus-3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 0cd82f45-f470-440f-b370-dc9e81aa749f, kind: Service { id: f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f }, name: Name("nexus-f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 198f5fa6-958e-4232-ac5f-5702fc084029, kind: Service { id: e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 }, name: Name("nexus-e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 179])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 706caacb-ebbc-449b-8437-4e867915d07d, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 56af848d-6b2f-4c6b-877e-88f0f71e4a3b, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5c06d8bc-673a-436d-bb7d-77d056cbc3f3, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: b0a819d3-df5a-4138-a4ca-faa819ce1889, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: e850cdd9-10d8-4f4a-9033-e925684705a8, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 9455c56f-ebb4-41f9-b986-4b7e571feacf, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External } } } }, OmicronZoneConfig { id: eddb8f4b-ab55-478c-8a50-4fc33a069dfb, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External } } } }, OmicronZoneConfig { id: 50112e8c-2fb9-4173-85af-76c33df6bf4c, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9fa79f1f-1a34-4f70-b524-eb7fdc322c00, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1fdc26fb-b263-4c2f-8644-ca7d8d273b44 (zpool), kind: External } } } }, OmicronZoneConfig { id: 99b60586-0809-4606-b8bc-47822105d2c0, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 23b2d7a5-435a-444f-8b3c-4170f8f73f40 (zpool), kind: External } } } }, OmicronZoneConfig { id: e76c9536-02ed-4bc3-89a0-0d0538f16543, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 23f948a5-169f-4744-8cb4-c0ecf022e665 (zpool), kind: External } } } }, OmicronZoneConfig { id: cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 70df896f-091c-40a3-a0c4-31293f39c2cc (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
9532024-06-12T21:27:17.706ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37271
9542024-06-12T21:27:17.707ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7a5079d1-e23b-479f-b97a-d95e79e68987, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9552024-06-12T21:27:17.707ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7a5079d1-e23b-479f-b97a-d95e79e68987, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9562024-06-12T21:27:17.731ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9572024-06-12T21:27:17.731ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: d1ceb977-d8a7-408a-bf7a-94d9c2ee3d39, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9582024-06-12T21:27:17.749ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a917873f-d73b-44e9-a1be-6517681cda1b, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9592024-06-12T21:27:17.749ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: a917873f-d73b-44e9-a1be-6517681cda1b, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: InternalDns }, responder: ... }
9602024-06-12T21:27:17.770ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 07357eaf-0fd5-41ef-84e7-5b6afa791785, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9612024-06-12T21:27:17.770ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 07357eaf-0fd5-41ef-84e7-5b6afa791785, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9622024-06-12T21:27:17.789ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9cbd4d02-bfd3-4c3e-80f4-d87add71e87e, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9632024-06-12T21:27:17.789ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9cbd4d02-bfd3-4c3e-80f4-d87add71e87e, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9642024-06-12T21:27:17.807ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 56ae27de-50df-47a7-8319-127824288379, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9652024-06-12T21:27:17.807ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 56ae27de-50df-47a7-8319-127824288379, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9662024-06-12T21:27:17.824ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 96206cb9-5198-49b4-8622-38209f52b88a, dataset_name: DatasetName { pool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9672024-06-12T21:27:17.824ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 96206cb9-5198-49b4-8622-38209f52b88a, dataset_name: DatasetName { pool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9682024-06-12T21:27:17.842ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 31a3b42f-4724-4394-a99b-682858677628, dataset_name: DatasetName { pool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:381
9692024-06-12T21:27:17.842ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 31a3b42f-4724-4394-a99b-682858677628, dataset_name: DatasetName { pool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9702024-06-12T21:27:17.860ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9712024-06-12T21:27:17.860ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9722024-06-12T21:27:17.987ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c848ab67-c488-4921-ac9a-d662e7f440af, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:381
9732024-06-12T21:27:17.987ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: c848ab67-c488-4921-ac9a-d662e7f440af, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9742024-06-12T21:27:18.124ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 56af848d-6b2f-4c6b-877e-88f0f71e4a3b, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:381
9752024-06-12T21:27:18.124ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 56af848d-6b2f-4c6b-877e-88f0f71e4a3b, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9762024-06-12T21:27:18.234ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9455c56f-ebb4-41f9-b986-4b7e571feacf, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9772024-06-12T21:27:18.235ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9455c56f-ebb4-41f9-b986-4b7e571feacf, dataset_name: DatasetName { pool_name: ZpoolName { id: fdc5c351-bd0c-490e-a824-bb2f2b967954 (zpool), kind: External }, kind: Crucible }, responder: ... }
9782024-06-12T21:27:18.343ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9792024-06-12T21:27:18.343ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8, dataset_name: DatasetName { pool_name: ZpoolName { id: 15994f92-33d0-4f72-971d-e91c145bfd50 (zpool), kind: External }, kind: Crucible }, responder: ... }
9802024-06-12T21:27:18.456ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: eddb8f4b-ab55-478c-8a50-4fc33a069dfb, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9812024-06-12T21:27:18.456ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: eddb8f4b-ab55-478c-8a50-4fc33a069dfb, dataset_name: DatasetName { pool_name: ZpoolName { id: a460ece5-fa75-4a2f-9cbe-a135dc5396ce (zpool), kind: External }, kind: Crucible }, responder: ... }
9822024-06-12T21:27:18.540ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 50112e8c-2fb9-4173-85af-76c33df6bf4c, dataset_name: DatasetName { pool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9832024-06-12T21:27:18.541ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 50112e8c-2fb9-4173-85af-76c33df6bf4c, dataset_name: DatasetName { pool_name: ZpoolName { id: 163451ca-17b3-4f83-ab53-55a998e6b8c3 (zpool), kind: External }, kind: Crucible }, responder: ... }
9842024-06-12T21:27:18.635ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9852024-06-12T21:27:18.635ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2, dataset_name: DatasetName { pool_name: ZpoolName { id: 8043b355-0fd3-40fc-8db4-22fae40be7a4 (zpool), kind: External }, kind: Crucible }, responder: ... }
9862024-06-12T21:27:18.733ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9fa79f1f-1a34-4f70-b524-eb7fdc322c00, dataset_name: DatasetName { pool_name: ZpoolName { id: 1fdc26fb-b263-4c2f-8644-ca7d8d273b44 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9872024-06-12T21:27:18.733ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 9fa79f1f-1a34-4f70-b524-eb7fdc322c00, dataset_name: DatasetName { pool_name: ZpoolName { id: 1fdc26fb-b263-4c2f-8644-ca7d8d273b44 (zpool), kind: External }, kind: Crucible }, responder: ... }
9882024-06-12T21:27:18.855ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 99b60586-0809-4606-b8bc-47822105d2c0, dataset_name: DatasetName { pool_name: ZpoolName { id: 23b2d7a5-435a-444f-8b3c-4170f8f73f40 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9892024-06-12T21:27:18.856ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: 99b60586-0809-4606-b8bc-47822105d2c0, dataset_name: DatasetName { pool_name: ZpoolName { id: 23b2d7a5-435a-444f-8b3c-4170f8f73f40 (zpool), kind: External }, kind: Crucible }, responder: ... }
9902024-06-12T21:27:18.972ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e76c9536-02ed-4bc3-89a0-0d0538f16543, dataset_name: DatasetName { pool_name: ZpoolName { id: 23f948a5-169f-4744-8cb4-c0ecf022e665 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9912024-06-12T21:27:18.972ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: e76c9536-02ed-4bc3-89a0-0d0538f16543, dataset_name: DatasetName { pool_name: ZpoolName { id: 23f948a5-169f-4744-8cb4-c0ecf022e665 (zpool), kind: External }, kind: Crucible }, responder: ... }
9922024-06-12T21:27:19.099ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 70df896f-091c-40a3-a0c4-31293f39c2cc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:381
9932024-06-12T21:27:19.099ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:809 request = NewFilesystemRequest { dataset_id: cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 70df896f-091c-40a3-a0c4-31293f39c2cc (zpool), kind: External }, kind: Crucible }, responder: ... }
9942024-06-12T21:27:19.213ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9952024-06-12T21:27:19.213ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/omicron-zones.json file = common/src/ledger.rs:177
9962024-06-12T21:27:19.214ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/omicron-zones.json file = common/src/ledger.rs:177
9972024-06-12T21:27:19.214ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
9982024-06-12T21:27:19.354ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
9992024-06-12T21:27:19.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10002024-06-12T21:27:19.354ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10012024-06-12T21:27:19.413ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10022024-06-12T21:27:19.413ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10032024-06-12T21:27:19.413ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10042024-06-12T21:27:19.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10052024-06-12T21:27:19.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10062024-06-12T21:27:19.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10072024-06-12T21:27:19.415ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10082024-06-12T21:27:19.623ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
10092024-06-12T21:27:19.623ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10102024-06-12T21:27:19.623ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10112024-06-12T21:27:19.623ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10122024-06-12T21:27:19.623ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10132024-06-12T21:27:19.625ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
10142024-06-12T21:27:19.648ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
10152024-06-12T21:27:19.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10162024-06-12T21:27:19.650ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:259
10172024-06-12T21:27:19.650ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b file = illumos-utils/src/zone.rs:315
10182024-06-12T21:27:19.656ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf file = illumos-utils/src/zone.rs:315
10192024-06-12T21:27:19.662ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2 file = illumos-utils/src/zone.rs:315
10202024-06-12T21:27:19.667ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00 file = illumos-utils/src/zone.rs:315
10212024-06-12T21:27:19.672ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889 file = illumos-utils/src/zone.rs:315
10222024-06-12T21:27:19.677ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb file = illumos-utils/src/zone.rs:315
10232024-06-12T21:27:19.682ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0 file = illumos-utils/src/zone.rs:315
10242024-06-12T21:27:19.687ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c file = illumos-utils/src/zone.rs:315
10252024-06-12T21:27:19.692ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3 file = illumos-utils/src/zone.rs:315
10262024-06-12T21:27:19.798ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b file = illumos-utils/src/zone.rs:354
10272024-06-12T21:27:19.803ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf file = illumos-utils/src/zone.rs:354
10282024-06-12T21:27:19.807ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2 file = illumos-utils/src/zone.rs:354
10292024-06-12T21:27:19.815ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00 file = illumos-utils/src/zone.rs:354
10302024-06-12T21:27:19.819ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889 file = illumos-utils/src/zone.rs:354
10312024-06-12T21:27:19.824ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb file = illumos-utils/src/zone.rs:354
10322024-06-12T21:27:19.829ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0 file = illumos-utils/src/zone.rs:354
10332024-06-12T21:27:19.834ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c file = illumos-utils/src/zone.rs:354
10342024-06-12T21:27:19.839ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3 file = illumos-utils/src/zone.rs:354
10352024-06-12T21:27:19.845ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8 file = illumos-utils/src/zone.rs:315
10362024-06-12T21:27:19.850ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2 file = illumos-utils/src/zone.rs:315
10372024-06-12T21:27:19.855ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d file = illumos-utils/src/zone.rs:315
10382024-06-12T21:27:19.860ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543 file = illumos-utils/src/zone.rs:315
10392024-06-12T21:27:19.866ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8 file = illumos-utils/src/zone.rs:315
10402024-06-12T21:27:19.872ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8 file = illumos-utils/src/zone.rs:354
10412024-06-12T21:27:19.879ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2 file = illumos-utils/src/zone.rs:354
10422024-06-12T21:27:19.885ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d file = illumos-utils/src/zone.rs:354
10432024-06-12T21:27:19.891ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543 file = illumos-utils/src/zone.rs:354
10442024-06-12T21:27:19.897ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8 file = illumos-utils/src/zone.rs:354
10452024-06-12T21:27:19.946ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10462024-06-12T21:27:19.993ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10472024-06-12T21:27:20.057ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10482024-06-12T21:27:20.115ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10492024-06-12T21:27:20.175ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:276
10502024-06-12T21:27:20.183ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10512024-06-12T21:27:20.183ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10522024-06-12T21:27:20.276ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 194, 126]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte1" } }
10532024-06-12T21:27:20.276ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10542024-06-12T21:27:20.279ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10552024-06-12T21:27:20.279ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10562024-06-12T21:27:20.439ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 246, 25]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte2" } }
10572024-06-12T21:27:20.439ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10582024-06-12T21:27:20.442ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10592024-06-12T21:27:20.442ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10602024-06-12T21:27:20.535ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 153, 123]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte3" } }
10612024-06-12T21:27:20.535ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10622024-06-12T21:27:20.538ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10632024-06-12T21:27:20.538ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10642024-06-12T21:27:20.623ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 139, 94]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte4" } }
10652024-06-12T21:27:20.623ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = external_dns
10662024-06-12T21:27:20.626ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:301
10672024-06-12T21:27:20.626ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:193
10682024-06-12T21:27:20.722ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 202, 179]), slot: 0, vni: Vni { inner: 100 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte5" } }
10692024-06-12T21:27:20.722ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1290 zone_type = nexus
10702024-06-12T21:27:20.724ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10712024-06-12T21:27:20.724ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10722024-06-12T21:27:20.726ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10732024-06-12T21:27:20.726ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10742024-06-12T21:27:20.726ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10752024-06-12T21:27:20.726ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10762024-06-12T21:27:20.727ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10772024-06-12T21:27:20.727ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10782024-06-12T21:27:20.727ZINFOSledAgent (ServiceManager): no nat entry found for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:102
10792024-06-12T21:27:20.727ZINFOSledAgent (ServiceManager): creating nat entry for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:109
10802024-06-12T21:27:20.732ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.164, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10812024-06-12T21:27:20.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10822024-06-12T21:27:20.785ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.166, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10832024-06-12T21:27:20.789ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.165, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10842024-06-12T21:27:20.789ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10852024-06-12T21:27:20.793ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.168, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10862024-06-12T21:27:20.793ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10872024-06-12T21:27:20.796ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10882024-06-12T21:27:20.796ZINFOSledAgent (ServiceManager): creation of nat entry successful for: V4( Ipv4Network { addr: 10.151.2.167, prefix: 32, }, ) file = clients/dpd-client/src/lib.rs:137
10892024-06-12T21:27:20.955ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
10902024-06-12T21:27:20.991ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf file = illumos-utils/src/zone.rs:315
10912024-06-12T21:27:21.000ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 file = illumos-utils/src/zone.rs:315
10922024-06-12T21:27:21.009ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af file = illumos-utils/src/zone.rs:315
10932024-06-12T21:27:21.016ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 file = illumos-utils/src/zone.rs:315
10942024-06-12T21:27:21.024ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f file = illumos-utils/src/zone.rs:315
10952024-06-12T21:27:21.033ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf file = illumos-utils/src/zone.rs:354
10962024-06-12T21:27:21.042ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 file = illumos-utils/src/zone.rs:354
10972024-06-12T21:27:21.049ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af file = illumos-utils/src/zone.rs:354
10982024-06-12T21:27:21.057ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 file = illumos-utils/src/zone.rs:354
10992024-06-12T21:27:21.064ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f file = illumos-utils/src/zone.rs:354
11002024-06-12T21:27:23.019ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11012024-06-12T21:27:23.019ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11022024-06-12T21:27:23.019ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
11032024-06-12T21:27:23.028ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
11042024-06-12T21:27:23.040ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11052024-06-12T21:27:23.041ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
11062024-06-12T21:27:23.169ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_1fdc26fb-b263-4c2f-8644-ca7d8d273b44/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="dc0ee1af-3c16-44d5-92cc-0b271cf53c14"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11072024-06-12T21:27:23.220ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
11082024-06-12T21:27:23.273ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_a460ece5-fa75-4a2f-9cbe-a135dc5396ce/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="c60ae251-17cf-4d8e-a8ed-e5a5880df062"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11092024-06-12T21:27:23.273ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
11102024-06-12T21:27:32.658ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
11112024-06-12T21:27:32.810ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_23b2d7a5-435a-444f-8b3c-4170f8f73f40/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="6ff1073e-dff0-439f-b63d-8ad063e40e42"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11122024-06-12T21:27:32.822ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
11132024-06-12T21:27:32.981ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_163451ca-17b3-4f83-ab53-55a998e6b8c3/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="4d110304-ef7a-4a1e-b402-1fe1d112463a"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11142024-06-12T21:27:32.986ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_70df896f-091c-40a3-a0c4-31293f39c2cc/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="584dee0d-76af-413b-bb68-db94da17829c"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11152024-06-12T21:27:33.004ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_23f948a5-169f-4744-8cb4-c0ecf022e665/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="a690780f-ecac-4ae5-971c-3c75cdd08406"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11162024-06-12T21:27:33.011ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_15994f92-33d0-4f72-971d-e91c145bfd50/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="b99b4d20-e9f9-41ac-9808-91b735239fb7"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11172024-06-12T21:27:33.031ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_8043b355-0fd3-40fc-8db4-22fae40be7a4/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="efe260a2-9416-41c8-892e-5692adae28a3"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11182024-06-12T21:27:33.117ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
11192024-06-12T21:27:33.157ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
11202024-06-12T21:27:33.231ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
11212024-06-12T21:27:33.354ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
11222024-06-12T21:27:33.400ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
11232024-06-12T21:27:33.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 74.887282ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
11242024-06-12T21:27:33.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 38.284191ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
11252024-06-12T21:27:33.931ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 111.938132868s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:417 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
11262024-06-12T21:27:34.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 68.767177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
11272024-06-12T21:27:34.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 92.134949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
11282024-06-12T21:27:34.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 94.558569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
11292024-06-12T21:27:34.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 75.362577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
11302024-06-12T21:27:34.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 55.037238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
11312024-06-12T21:27:34.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 104.015894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
11322024-06-12T21:27:34.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 228.490397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
11332024-06-12T21:27:34.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 171.485759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
11342024-06-12T21:27:34.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 69.977928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
11352024-06-12T21:27:34.987ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 533.009427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
11362024-06-12T21:27:35.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 55.365742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
11372024-06-12T21:27:35.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 51.310098ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
11382024-06-12T21:27:35.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 51.899661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
11392024-06-12T21:27:35.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 262.382663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
11402024-06-12T21:27:35.103ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 200.152009ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
11412024-06-12T21:27:35.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 55.670474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
11422024-06-12T21:27:35.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 31.832599ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
11432024-06-12T21:27:35.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 56.451999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
11442024-06-12T21:27:35.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 53.45713ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
11452024-06-12T21:27:35.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 277.132ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
11462024-06-12T21:27:35.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 114.478704ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
11472024-06-12T21:27:35.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 117.677377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
11482024-06-12T21:27:35.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 87.178381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
11492024-06-12T21:27:35.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 710.132209ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
11502024-06-12T21:27:35.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 775.959864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
11512024-06-12T21:27:35.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 63.145786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
11522024-06-12T21:27:35.507ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="706caacb-ebbc-449b-8437-4e867915d07d"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11532024-06-12T21:27:35.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 74.077427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
11542024-06-12T21:27:35.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 144.238136ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
11552024-06-12T21:27:35.544ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_fdc5c351-bd0c-490e-a824-bb2f2b967954/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="70a6d3a4-2291-45f2-b34e-8129632dd50e"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11562024-06-12T21:27:35.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 68.057718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
11572024-06-12T21:27:35.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 922.62379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
11582024-06-12T21:27:35.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 159.975069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
11592024-06-12T21:27:35.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 163.857504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
11602024-06-12T21:27:35.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 191.169037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
11612024-06-12T21:27:35.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 256.606522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
11622024-06-12T21:27:35.624ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
11632024-06-12T21:27:35.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 257.174786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
11642024-06-12T21:27:35.645ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
11652024-06-12T21:27:35.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 181.69443ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
11662024-06-12T21:27:35.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 427.89537ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
11672024-06-12T21:27:35.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 167.577665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
11682024-06-12T21:27:35.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 448.70141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
11692024-06-12T21:27:35.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 523.63867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
11702024-06-12T21:27:35.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 509.180714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
11712024-06-12T21:27:35.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 401.324423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
11722024-06-12T21:27:35.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 55.162112ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
11732024-06-12T21:27:35.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 510.243859ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
11742024-06-12T21:27:35.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 457.005781ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
11752024-06-12T21:27:35.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 48.291081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
11762024-06-12T21:27:35.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 494.772042ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
11772024-06-12T21:27:35.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 109.235973ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
11782024-06-12T21:27:36.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 135.746321ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
11792024-06-12T21:27:36.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 294.061928ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
11802024-06-12T21:27:36.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 1.103890493s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
11812024-06-12T21:27:36.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 1.261287255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
11822024-06-12T21:27:36.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 271.194682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
11832024-06-12T21:27:36.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 588.988362ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
11842024-06-12T21:27:36.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 530.154316ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
11852024-06-12T21:27:36.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 679.517313ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
11862024-06-12T21:27:36.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 1.064571931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
11872024-06-12T21:27:36.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 740.518849ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
11882024-06-12T21:27:36.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 849.961871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
11892024-06-12T21:27:36.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 545.057464ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
11902024-06-12T21:27:36.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 448.146177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
11912024-06-12T21:27:36.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 447.957379ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
11922024-06-12T21:27:36.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 848.672907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
11932024-06-12T21:27:36.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 886.516229ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
11942024-06-12T21:27:36.752ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11952024-06-12T21:27:36.753ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
11962024-06-12T21:27:36.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 1.157255245s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
11972024-06-12T21:27:36.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 1.167478485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
11982024-06-12T21:27:36.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 1.410816933s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
11992024-06-12T21:27:36.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 441.517116ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
12002024-06-12T21:27:36.980ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 838.762935ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
12012024-06-12T21:27:36.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 1.014197786s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
12022024-06-12T21:27:37.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 70.445262ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
12032024-06-12T21:27:37.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 74.228772ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
12042024-06-12T21:27:37.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 1.397988157s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
12052024-06-12T21:27:37.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 177.983319ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
12062024-06-12T21:27:37.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 598.694663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
12072024-06-12T21:27:37.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 592.855554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
12082024-06-12T21:27:37.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 580.376236ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
12092024-06-12T21:27:37.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 1.061084626s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
12102024-06-12T21:27:37.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 1.215735624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
12112024-06-12T21:27:37.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 1.190708671s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
12122024-06-12T21:27:37.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 1.123618058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
12132024-06-12T21:27:37.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 909.59071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
12142024-06-12T21:27:37.551ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12152024-06-12T21:27:37.551ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
12162024-06-12T21:27:37.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 612.005215ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
12172024-06-12T21:27:37.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 54.728091ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
12182024-06-12T21:27:37.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 714.972184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
12192024-06-12T21:27:37.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 1.497737887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
12202024-06-12T21:27:37.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 120.13911ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
12212024-06-12T21:27:38.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 638.241468ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
12222024-06-12T21:27:38.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 1.285131205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
12232024-06-12T21:27:38.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 1.186089426s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
12242024-06-12T21:27:38.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 1.02976671s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
12252024-06-12T21:27:38.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 163.149599ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
12262024-06-12T21:27:38.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 523.441303ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
12272024-06-12T21:27:38.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 942.91828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
12282024-06-12T21:27:38.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 643.500018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
12292024-06-12T21:27:38.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 1.169826539s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
12302024-06-12T21:27:38.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 623.6126ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
12312024-06-12T21:27:38.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 791.131047ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
12322024-06-12T21:27:38.557ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12332024-06-12T21:27:38.558ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342024-06-12T21:27:38.558ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
12352024-06-12T21:27:38.571ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
12362024-06-12T21:27:38.586ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12372024-06-12T21:27:38.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 676.589116ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
12382024-06-12T21:27:38.620ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
12392024-06-12T21:27:38.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 1.450739695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
12402024-06-12T21:27:38.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 894.971762ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
12412024-06-12T21:27:38.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 510.438517ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
12422024-06-12T21:27:38.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 1.185365542s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
12432024-06-12T21:27:38.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 556.170049ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
12442024-06-12T21:27:38.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 68.569375ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
12452024-06-12T21:27:38.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 52.7706ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
12462024-06-12T21:27:38.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 34.000726ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
12472024-06-12T21:27:38.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 134.237887ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
12482024-06-12T21:27:38.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 116.119638ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
12492024-06-12T21:27:39.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 98.164513ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
12502024-06-12T21:27:39.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 1.191897206s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
12512024-06-12T21:27:39.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 221.114742ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
12522024-06-12T21:27:39.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 866.396759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
12532024-06-12T21:27:39.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 519.772616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
12542024-06-12T21:27:39.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 1.151205861s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
12552024-06-12T21:27:39.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 1.281136501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
12562024-06-12T21:27:39.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 1.164810089s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
12572024-06-12T21:27:39.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 1.364693512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
12582024-06-12T21:27:39.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 1.02455379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
12592024-06-12T21:27:39.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 809.180613ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
12602024-06-12T21:27:39.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 188.18419ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
12612024-06-12T21:27:39.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 1.20214223s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
12622024-06-12T21:27:39.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 1.207941466s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
12632024-06-12T21:27:39.560ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 245.60899ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
12642024-06-12T21:27:39.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 1.088443739s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
12652024-06-12T21:27:39.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 324.068052ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
12662024-06-12T21:27:39.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 928.76585ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
12672024-06-12T21:27:39.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 580.653939ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
12682024-06-12T21:27:39.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 562.946586ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
12692024-06-12T21:27:39.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 998.679032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
12702024-06-12T21:27:39.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 1.338146729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
12712024-06-12T21:27:39.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 857.470877ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
12722024-06-12T21:27:40.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 806.305079ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
12732024-06-12T21:27:40.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 748.894691ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
12742024-06-12T21:27:40.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 984.331352ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
12752024-06-12T21:27:40.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 1.230524199s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
12762024-06-12T21:27:40.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 995.733302ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
12772024-06-12T21:27:40.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 1.061046802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
12782024-06-12T21:27:40.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 1.145712162s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
12792024-06-12T21:27:40.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 1.038991503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
12802024-06-12T21:27:40.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 637.096657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
12812024-06-12T21:27:40.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 965.829226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
12822024-06-12T21:27:40.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 959.80014ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
12832024-06-12T21:27:40.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 552.417732ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
12842024-06-12T21:27:40.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 1.26122881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
12852024-06-12T21:27:40.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 1.000116414s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
12862024-06-12T21:27:40.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 676.843039ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
12872024-06-12T21:27:40.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 1.07811782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
12882024-06-12T21:27:40.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 584.772378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
12892024-06-12T21:27:40.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 735.746915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
12902024-06-12T21:27:41.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 1.441114246s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
12912024-06-12T21:27:41.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 1.392217205s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
12922024-06-12T21:27:41.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 1.437058386s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
12932024-06-12T21:27:41.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 1.05821257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
12942024-06-12T21:27:41.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 1.061474131s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
12952024-06-12T21:27:41.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 641.016249ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
12962024-06-12T21:27:41.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 1.094711726s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
12972024-06-12T21:27:41.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 1.043744464s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
12982024-06-12T21:27:41.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 1.094715738s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
12992024-06-12T21:27:41.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 1.45345447s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
13002024-06-12T21:27:41.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 1.415462894s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
13012024-06-12T21:27:41.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 1.203920555s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
13022024-06-12T21:27:41.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 780.444354ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
13032024-06-12T21:27:41.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 1.344606398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
13042024-06-12T21:27:41.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 1.118719534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
13052024-06-12T21:27:41.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 846.185535ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
13062024-06-12T21:27:41.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 683.048947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
13072024-06-12T21:27:42.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 857.086867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
13082024-06-12T21:27:42.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 1.369230421s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
13092024-06-12T21:27:42.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 768.074297ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
13102024-06-12T21:27:42.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 545.401695ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
13112024-06-12T21:27:42.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 1.336404607s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
13122024-06-12T21:27:42.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 732.596369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
13132024-06-12T21:27:42.525ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13142024-06-12T21:27:42.526ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
13152024-06-12T21:27:42.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 1.106286251s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
13162024-06-12T21:27:42.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 576.331208ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
13172024-06-12T21:27:42.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 1.390439552s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
13182024-06-12T21:27:42.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 1.406879037s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
13192024-06-12T21:27:42.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 1.000175662s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
13202024-06-12T21:27:42.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 1.352340257s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
13212024-06-12T21:27:42.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 790.203225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
13222024-06-12T21:27:42.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 51.0603ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
13232024-06-12T21:27:42.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 70.041475ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
13242024-06-12T21:27:42.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 1.429866405s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
13252024-06-12T21:27:42.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 993.770407ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
13262024-06-12T21:27:42.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 293.443426ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
13272024-06-12T21:27:43.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 954.073867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
13282024-06-12T21:27:43.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 1.344505473s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
13292024-06-12T21:27:43.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 676.805358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
13302024-06-12T21:27:43.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 1.385606574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
13312024-06-12T21:27:43.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 822.178644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
13322024-06-12T21:27:43.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 1.318963708s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
13332024-06-12T21:27:43.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 1.37503518s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
13342024-06-12T21:27:43.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 301.121986ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
13352024-06-12T21:27:43.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 806.66387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
13362024-06-12T21:27:43.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 865.721606ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
13372024-06-12T21:27:43.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 704.044773ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
13382024-06-12T21:27:43.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 1.166748127s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
13392024-06-12T21:27:43.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 1.157143174s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
13402024-06-12T21:27:43.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 1.432626897s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
13412024-06-12T21:27:43.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 1.270190005s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
13422024-06-12T21:27:43.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 1.413942121s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
13432024-06-12T21:27:43.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 628.019992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
13442024-06-12T21:27:44.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 599.998348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
13452024-06-12T21:27:44.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 1.424149719s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
13462024-06-12T21:27:44.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 728.666984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
13472024-06-12T21:27:44.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 1.422506194s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
13482024-06-12T21:27:44.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 618.361416ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
13492024-06-12T21:27:44.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 704.800909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
13502024-06-12T21:27:44.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 815.716712ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
13512024-06-12T21:27:44.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 1.280147091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
13522024-06-12T21:27:44.343ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 573.831189ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
13532024-06-12T21:27:44.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 1.290640294s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
13542024-06-12T21:27:44.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 913.407667ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
13552024-06-12T21:27:44.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb") failed: Property not found. retry in 1.498297428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
13562024-06-12T21:27:44.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 738.236386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
13572024-06-12T21:27:44.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 1.494012406s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
13582024-06-12T21:27:44.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543") failed: Property not found. retry in 1.397670396s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
13592024-06-12T21:27:44.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 908.062295ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
13602024-06-12T21:27:44.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 1.481244258s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
13612024-06-12T21:27:44.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 658.227772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
13622024-06-12T21:27:44.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 505.74468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
13632024-06-12T21:27:44.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 1.212934836s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
13642024-06-12T21:27:44.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 1.140923968s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
13652024-06-12T21:27:45.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889") failed: Property not found. retry in 1.287507588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
13662024-06-12T21:27:45.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 918.315744ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
13672024-06-12T21:27:45.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00") failed: Property not found. retry in 1.442371478s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
13682024-06-12T21:27:45.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0") failed: Property not found. retry in 1.005413423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
13692024-06-12T21:27:45.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8") failed: Property not found. retry in 1.180251494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
13702024-06-12T21:27:45.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2") failed: Property not found. retry in 980.152127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
13712024-06-12T21:27:45.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c") failed: Property not found. retry in 769.900586ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
13722024-06-12T21:27:45.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2") failed: Property not found. retry in 1.388778595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
13732024-06-12T21:27:45.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8") failed: Property not found. retry in 1.191146837s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
13742024-06-12T21:27:45.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 619.546006ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
13752024-06-12T21:27:45.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3") failed: Property not found. retry in 1.015756274s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
13762024-06-12T21:27:45.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 1.164674428s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
13772024-06-12T21:27:45.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 1.116601613s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
13782024-06-12T21:27:46.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 806.596682ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
13792024-06-12T21:27:46.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 898.394927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
13802024-06-12T21:27:46.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 890.481232ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
13812024-06-12T21:27:46.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 995.034141ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
13822024-06-12T21:27:46.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 520.353713ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
13832024-06-12T21:27:46.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 1.311069939s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
13842024-06-12T21:27:46.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 921.945217ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
13852024-06-12T21:27:46.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 512.915509ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
13862024-06-12T21:27:46.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d") failed: Property not found. retry in 689.838494ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
13872024-06-12T21:27:46.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 601.769763ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
13882024-06-12T21:27:47.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf") failed: Property not found. retry in 1.335273112s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
13892024-06-12T21:27:47.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 1.098471892s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
13902024-06-12T21:27:47.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 1.316089135s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
13912024-06-12T21:27:47.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af") failed: Property not found. retry in 1.383256618s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
13922024-06-12T21:27:47.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 1.283819503s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
13932024-06-12T21:27:47.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 1.302580235s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
13942024-06-12T21:27:47.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf") failed: Property not found. retry in 827.758432ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
13952024-06-12T21:27:47.898ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62811
13962024-06-12T21:27:47.983ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 34091 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62811 req_id = c30b16a2-1230-4b61-9e92-e429c45fb509 response_code = 200 uri = /baseboard
13972024-06-12T21:27:48.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 1.359172885s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
13982024-06-12T21:27:48.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 504.380851ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
13992024-06-12T21:27:48.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7") failed: Property not found. retry in 1.250728843s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
14002024-06-12T21:27:48.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 1.452255809s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
14012024-06-12T21:27:49.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51") failed: Property not found. retry in 902.157327ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
14022024-06-12T21:27:49.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f") failed: Property not found. retry in 1.179900888s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
14032024-06-12T21:27:50.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 767.939454ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
14042024-06-12T21:27:51.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b") failed: Property not found. retry in 723.675849ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
14052024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_clickhouse_56af848d-6b2f-4c6b-877e-88f0f71e4a3b
14062024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_9455c56f-ebb4-41f9-b986-4b7e571feacf
14072024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_nexus_f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f
14082024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_7d54ae3d-cbc6-4ec3-9e0c-e8080fcb0ba2
14092024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_9fa79f1f-1a34-4f70-b524-eb7fdc322c00
14102024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_pantry_b0a819d3-df5a-4138-a4ca-faa819ce1889
14112024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_eddb8f4b-ab55-478c-8a50-4fc33a069dfb
14122024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_99b60586-0809-4606-b8bc-47822105d2c0
14132024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_50112e8c-2fb9-4173-85af-76c33df6bf4c
14142024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_pantry_5c06d8bc-673a-436d-bb7d-77d056cbc3f3
14152024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_pantry_e850cdd9-10d8-4f4a-9033-e925684705a8
14162024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_cd8d6d89-fd2f-4f5c-adac-4edfa2e9f1f2
14172024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_oximeter_706caacb-ebbc-449b-8437-4e867915d07d
14182024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_e76c9536-02ed-4bc3-89a0-0d0538f16543
14192024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_external_dns_2104361f-f28a-4d05-9bef-d2bf9cc7accf
14202024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_nexus_3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7
14212024-06-12T21:27:51.915ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_crucible_9f258f4c-2d40-4cba-8a5f-31e3dcbcabf8
14222024-06-12T21:27:51.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_external_dns_c848ab67-c488-4921-ac9a-d662e7f440af
14232024-06-12T21:27:51.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3056 zone = oxz_nexus_e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51
14242024-06-12T21:27:51.937ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14252024-06-12T21:27:51.952ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14262024-06-12T21:27:51.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 34264733 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37271 req_id = f5f47c1d-5462-4801-b429-9ad4a41ea053 response_code = 204 uri = /omicron-zones
14272024-06-12T21:27:52.007ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1244
14282024-06-12T21:27:52.007ZINFOSledAgent (RSS): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14292024-06-12T21:27:52.007ZINFOSledAgent (RSS): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14302024-06-12T21:27:52.047ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:681
14312024-06-12T21:27:52.050ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:694
14322024-06-12T21:27:52.136ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:825
14332024-06-12T21:27:52.164ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14342024-06-12T21:27:52.259ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14352024-06-12T21:27:52.419ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14362024-06-12T21:27:52.591ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14372024-06-12T21:27:52.806ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14382024-06-12T21:27:53.064ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14392024-06-12T21:27:53.222ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14402024-06-12T21:27:53.608ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14412024-06-12T21:27:53.799ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14422024-06-12T21:27:54.359ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14432024-06-12T21:27:54.902ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14442024-06-12T21:27:55.568ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14452024-06-12T21:27:56.434ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14462024-06-12T21:27:57.579ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14472024-06-12T21:27:58.126ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14482024-06-12T21:27:59.954ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/4a59bdcc-0dd9-4487-9f85-3e04212a83c6/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14492024-06-12T21:28:02.105ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0a1d90ce-2556-4264-add7-0bef21250ad0", "content-length": "173", "date": "Wed, 12 Jun 2024 21:28:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3196594c-bc4a-474e-a0a2-7a0af521e0d4\"", request_id: "0a1d90ce-2556-4264-add7-0bef21250ad0" } file = sled-agent/src/rack_setup/service.rs:887
14502024-06-12T21:28:03.407ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "56875ce2-65d3-4003-b987-6c398c43f8da", "content-length": "173", "date": "Wed, 12 Jun 2024 21:28:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3196594c-bc4a-474e-a0a2-7a0af521e0d4\"", request_id: "56875ce2-65d3-4003-b987-6c398c43f8da" } file = sled-agent/src/rack_setup/service.rs:887
14512024-06-12T21:28:06.360ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "16b8cc39-2445-4766-a558-31127620815d", "content-length": "173", "date": "Wed, 12 Jun 2024 21:28:06 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"3196594c-bc4a-474e-a0a2-7a0af521e0d4\"", request_id: "16b8cc39-2445-4766-a558-31127620815d" } file = sled-agent/src/rack_setup/service.rs:887
14522024-06-12T21:28:06.734ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
14532024-06-12T21:28:06.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64779
14542024-06-12T21:28:06.888ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14552024-06-12T21:28:06.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64779 req_id = ef2a1a2e-1820-4f8c-98d9-e5af6635f7dc response_code = 200 uri = /inventory
14562024-06-12T21:28:06.977ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14572024-06-12T21:28:06.977ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/omicron-zones.json file = common/src/ledger.rs:177
14582024-06-12T21:28:06.980ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/omicron-zones.json file = common/src/ledger.rs:177
14592024-06-12T21:28:06.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6787 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64779 req_id = 9e270208-081f-4900-bb81-825d2dedad01 response_code = 200 uri = /omicron-zones
14602024-06-12T21:28:08.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37610
14612024-06-12T21:28:08.732ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f3f370-9025-4e91-be90-414e2843437b, kind: Service { id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf }, name: Name("external-dns-2104361f-f28a-4d05-9bef-d2bf9cc7accf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ba8d2a2b-5248-4f73-bcdc-4bb653022a9a, kind: Service { id: c848ab67-c488-4921-ac9a-d662e7f440af }, name: Name("external-dns-c848ab67-c488-4921-ac9a-d662e7f440af"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd82f45-f470-440f-b370-dc9e81aa749f, kind: Service { id: f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f }, name: Name("nexus-f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 198f5fa6-958e-4232-ac5f-5702fc084029, kind: Service { id: e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 }, name: Name("nexus-e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 179])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 28dc4374-c469-46f9-a3ff-03ae425af71b, kind: Service { id: 3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 }, name: Name("nexus-3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14622024-06-12T21:28:08.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14632024-06-12T21:28:08.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14642024-06-12T21:28:08.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14652024-06-12T21:28:08.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
14662024-06-12T21:28:08.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14672024-06-12T21:28:08.733ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14682024-06-12T21:28:08.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4774 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37610 req_id = b8a7712f-05c9-4020-8f44-80b0f8c0f689 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14692024-06-12T21:28:08.734ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:897
14702024-06-12T21:28:08.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36528
14712024-06-12T21:28:08.988ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14722024-06-12T21:28:09.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 88808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 31c4295b-08eb-4642-9238-f477d7f2c80a response_code = 200 uri = /inventory
14732024-06-12T21:28:09.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55179
14742024-06-12T21:28:09.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34309
14752024-06-12T21:28:09.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39711
14762024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f3f370-9025-4e91-be90-414e2843437b, kind: Service { id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf }, name: Name("external-dns-2104361f-f28a-4d05-9bef-d2bf9cc7accf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ba8d2a2b-5248-4f73-bcdc-4bb653022a9a, kind: Service { id: c848ab67-c488-4921-ac9a-d662e7f440af }, name: Name("external-dns-c848ab67-c488-4921-ac9a-d662e7f440af"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd82f45-f470-440f-b370-dc9e81aa749f, kind: Service { id: f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f }, name: Name("nexus-f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 198f5fa6-958e-4232-ac5f-5702fc084029, kind: Service { id: e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 }, name: Name("nexus-e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 179])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 28dc4374-c469-46f9-a3ff-03ae425af71b, kind: Service { id: 3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 }, name: Name("nexus-3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14772024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14782024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14792024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14802024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
14812024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14822024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f3f370-9025-4e91-be90-414e2843437b, kind: Service { id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf }, name: Name("external-dns-2104361f-f28a-4d05-9bef-d2bf9cc7accf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ba8d2a2b-5248-4f73-bcdc-4bb653022a9a, kind: Service { id: c848ab67-c488-4921-ac9a-d662e7f440af }, name: Name("external-dns-c848ab67-c488-4921-ac9a-d662e7f440af"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd82f45-f470-440f-b370-dc9e81aa749f, kind: Service { id: f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f }, name: Name("nexus-f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 198f5fa6-958e-4232-ac5f-5702fc084029, kind: Service { id: e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 }, name: Name("nexus-e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 179])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 28dc4374-c469-46f9-a3ff-03ae425af71b, kind: Service { id: 3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 }, name: Name("nexus-3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14832024-06-12T21:28:09.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
14842024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14852024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f3f370-9025-4e91-be90-414e2843437b, kind: Service { id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf }, name: Name("external-dns-2104361f-f28a-4d05-9bef-d2bf9cc7accf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ba8d2a2b-5248-4f73-bcdc-4bb653022a9a, kind: Service { id: c848ab67-c488-4921-ac9a-d662e7f440af }, name: Name("external-dns-c848ab67-c488-4921-ac9a-d662e7f440af"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd82f45-f470-440f-b370-dc9e81aa749f, kind: Service { id: f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f }, name: Name("nexus-f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 198f5fa6-958e-4232-ac5f-5702fc084029, kind: Service { id: e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 }, name: Name("nexus-e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 179])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 28dc4374-c469-46f9-a3ff-03ae425af71b, kind: Service { id: 3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 }, name: Name("nexus-3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14862024-06-12T21:28:09.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 899 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34309 req_id = b8313002-5794-4e99-bbd6-89fc168c46c3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14872024-06-12T21:28:09.078ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14882024-06-12T21:28:09.078ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/config/omicron-zones.json file = common/src/ledger.rs:177
14892024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14902024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14912024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
14922024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14932024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14942024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14952024-06-12T21:28:09.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1009 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39711 req_id = ea112c8d-a36a-47dc-953e-ec67eb85825a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14962024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14972024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14982024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
14992024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15002024-06-12T21:28:09.079ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15012024-06-12T21:28:09.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 832 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55179 req_id = 19377ac7-9db7-4fa0-bce7-8e7b8a10155d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15022024-06-12T21:28:09.079ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/config/omicron-zones.json file = common/src/ledger.rs:177
15032024-06-12T21:28:09.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1767 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36528 req_id = 6151770d-9e59-411e-a3bc-bf2027e97a71 response_code = 200 uri = /omicron-zones
15042024-06-12T21:28:18.037ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65266
15052024-06-12T21:28:18.037ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 83 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65266 req_id = 43ebde12-6be3-47c4-b589-122b980e7d32 response_code = 200 uri = /baseboard
15062024-06-12T21:28:30.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44992
15072024-06-12T21:28:30.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1372 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44992 req_id = 8938f1f5-4cca-4c43-b3b3-8335a3525928 response_code = 200 uri = /v2p
15082024-06-12T21:28:30.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47179
15092024-06-12T21:28:30.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47179 req_id = 4ef47d91-8d7a-48db-92bb-b6fd4a28c0ba response_code = 200 uri = /v2p
15102024-06-12T21:28:30.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50252
15112024-06-12T21:28:30.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50252 req_id = ff9c980f-6d54-42c9-9be1-6983472e979a response_code = 200 uri = /v2p
15122024-06-12T21:28:30.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56299
15132024-06-12T21:28:31.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103859 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56299 req_id = afc65e51-bc64-430a-b5d2-c7e6c6d498f6 response_code = 204 uri = /switch-ports
15142024-06-12T21:28:31.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43677
15152024-06-12T21:28:31.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 57387 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43677 req_id = 555a2b29-8c7e-484c-979e-74897cc36167 response_code = 204 uri = /switch-ports
15162024-06-12T21:28:31.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36942
15172024-06-12T21:28:31.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 5879 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56299 req_id = 2f3fe32b-f280-4a8b-beab-27ab38032e3c response_code = 200 uri = /network-bootstore-config
15182024-06-12T21:28:31.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 5727 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43677 req_id = f0858e8c-4d62-47ce-aaf1-edd9d30a56e3 response_code = 200 uri = /network-bootstore-config
15192024-06-12T21:28:31.123ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
15202024-06-12T21:28:31.123ZINFOSledAgent (bootstore): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15212024-06-12T21:28:31.128ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15222024-06-12T21:28:31.129ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
15232024-06-12T21:28:31.129ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
15242024-06-12T21:28:31.129ZINFOSledAgent (bootstore): Writing ledger to /pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15252024-06-12T21:28:31.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8791 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43677 req_id = e3b414da-b571-4b0a-87bb-feb1ba7c404f response_code = 204 uri = /network-bootstore-config
15262024-06-12T21:28:31.130ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e0099430-147d-4db6-a892-0d1b36d80310/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
15272024-06-12T21:28:31.130ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
15282024-06-12T21:28:31.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1659 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56299 req_id = be0fb055-311c-4d67-8fba-98ad90d8653c response_code = 204 uri = /network-bootstore-config
15292024-06-12T21:28:31.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 54932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36942 req_id = c22986bb-d805-4f4a-9590-4379970f17e4 response_code = 204 uri = /switch-ports
15302024-06-12T21:28:31.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36942 req_id = 82c2d38f-853c-4c3f-b0ed-e59690e962fa response_code = 200 uri = /network-bootstore-config
15312024-06-12T21:28:48.073ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50398
15322024-06-12T21:28:48.074ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 708 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50398 req_id = dba8a561-12c6-4409-beb2-4297ec5879a8 response_code = 200 uri = /baseboard
15332024-06-12T21:29:00.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60484
15342024-06-12T21:29:00.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60484 req_id = 6d18dd1b-1426-4641-ab6b-b0565d801816 response_code = 200 uri = /v2p
15352024-06-12T21:29:00.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46954
15362024-06-12T21:29:00.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46954 req_id = 321231ef-5e3a-487f-977a-5bde726c38df response_code = 200 uri = /v2p
15372024-06-12T21:29:00.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61781
15382024-06-12T21:29:00.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61781 req_id = 86c3da9f-3dac-463f-9a6e-d25fb2885e43 response_code = 200 uri = /v2p
15392024-06-12T21:29:00.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61045
15402024-06-12T21:29:01.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50709 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61045 req_id = 923325ac-1a45-4919-b84c-d4c69f19e509 response_code = 204 uri = /switch-ports
15412024-06-12T21:29:01.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61045 req_id = fe80a67a-6852-4c98-874c-40a5ecbdfa40 response_code = 200 uri = /network-bootstore-config
15422024-06-12T21:29:01.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61140
15432024-06-12T21:29:01.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49620 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61140 req_id = 269f87a5-fd8c-414b-aa29-f9f0e4e11dc7 response_code = 204 uri = /switch-ports
15442024-06-12T21:29:01.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 914 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61140 req_id = 5fcc04ca-8c37-4ff1-9b83-f1ddcc75b07e response_code = 200 uri = /network-bootstore-config
15452024-06-12T21:29:01.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64665
15462024-06-12T21:29:01.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45493 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64665 req_id = 7b2169b7-60ad-4542-9482-12a0205062cb response_code = 204 uri = /switch-ports
15472024-06-12T21:29:01.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64665 req_id = 65c1a858-85a7-4885-9a44-77870f6c6b3b response_code = 200 uri = /network-bootstore-config
15482024-06-12T21:29:18.129ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34757
15492024-06-12T21:29:18.129ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 59 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34757 req_id = 569e35d2-5809-4174-924d-5190a4c502a3 response_code = 200 uri = /baseboard
15502024-06-12T21:29:30.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44796
15512024-06-12T21:29:30.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44796 req_id = 03fff654-b9d3-4cb2-859f-cdbd5227314f response_code = 200 uri = /v2p
15522024-06-12T21:29:30.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64874
15532024-06-12T21:29:30.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64874 req_id = 7441eed8-834d-48ac-91e8-db8cf9d1569c response_code = 200 uri = /v2p
15542024-06-12T21:29:30.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60293
15552024-06-12T21:29:30.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60293 req_id = 325a1afb-c8cd-4d65-b56d-788a670cc8ac response_code = 200 uri = /v2p
15562024-06-12T21:29:30.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48586
15572024-06-12T21:29:30.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48586 req_id = 202361ca-1173-4778-a5ee-4854cbfb5f58 response_code = 204 uri = /switch-ports
15582024-06-12T21:29:30.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65389
15592024-06-12T21:29:30.879ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52581
15602024-06-12T21:29:30.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3792 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48586 req_id = 202dfefa-c7af-4c33-969b-2683164eae51 response_code = 200 uri = /network-bootstore-config
15612024-06-12T21:29:30.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47787 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65389 req_id = c2b529e9-fed4-4641-bfb4-ded11a3d9190 response_code = 204 uri = /switch-ports
15622024-06-12T21:29:30.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 644 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65389 req_id = c0a20e8e-2124-466e-a458-ebed9309f4d5 response_code = 200 uri = /network-bootstore-config
15632024-06-12T21:29:30.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89584 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52581 req_id = 7757ed30-7cbb-46c6-8cfe-8434953a5ffe response_code = 204 uri = /switch-ports
15642024-06-12T21:29:30.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52581 req_id = 5ec7aba5-17f4-4fe5-9ac2-74c6b8572aba response_code = 200 uri = /network-bootstore-config
15652024-06-12T21:29:48.163ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54878
15662024-06-12T21:29:48.164ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 561 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54878 req_id = 19c3782e-56a0-46df-9147-23e9570eaa3f response_code = 200 uri = /baseboard
15672024-06-12T21:29:55.999ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:33745 remote_addr = [fd00:1122:3344:101::d]:65049 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4
15682024-06-12T21:29:56.033ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 33235 local_addr = [fd00:1122:3344:101::1]:33745 method = GET remote_addr = [fd00:1122:3344:101::d]:65049 req_id = 97fd691b-e777-49e2-9357-acef7d4ac8b3 response_code = 200 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 uri = /3196594c-bc4a-474e-a0a2-7a0af521e0d4
15692024-06-12T21:30:00.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62157
15702024-06-12T21:30:00.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1924 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62157 req_id = 94efd17c-c7a2-4737-981e-f5fd09abbf41 response_code = 200 uri = /v2p
15712024-06-12T21:30:00.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37296
15722024-06-12T21:30:00.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37296 req_id = ce63e043-076e-4ac6-97c4-08f71160da51 response_code = 200 uri = /v2p
15732024-06-12T21:30:00.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63004
15742024-06-12T21:30:00.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1549 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63004 req_id = b2f61e05-fa3e-4684-a6c2-28b411ae5085 response_code = 200 uri = /v2p
15752024-06-12T21:30:01.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47444
15762024-06-12T21:30:01.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 66355 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47444 req_id = e97891e6-4c77-4f54-a0c3-43321494e933 response_code = 204 uri = /switch-ports
15772024-06-12T21:30:01.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34934
15782024-06-12T21:30:01.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4852 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47444 req_id = c34c3277-4dc4-4f32-a159-620fdcbd87b2 response_code = 200 uri = /network-bootstore-config
15792024-06-12T21:30:01.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39540
15802024-06-12T21:30:01.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 113666 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34934 req_id = 005e4d72-b1b8-447f-a3ed-0fa485f86d0c response_code = 204 uri = /switch-ports
15812024-06-12T21:30:01.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 692 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34934 req_id = 7d0c82a9-926a-4166-a397-cd15709b1916 response_code = 200 uri = /network-bootstore-config
15822024-06-12T21:30:01.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 109517 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39540 req_id = d8406f16-4ee1-4284-8a50-6ac25172d5fe response_code = 204 uri = /switch-ports
15832024-06-12T21:30:01.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39540 req_id = abcbe1f4-a0e0-4caf-9b64-6245bd082fcb response_code = 200 uri = /network-bootstore-config
15842024-06-12T21:30:18.199ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:34956
15852024-06-12T21:30:18.211ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:34956 req_id = d077c49a-5272-4122-a770-7fd829ebd7c4 response_code = 200 uri = /baseboard
15862024-06-12T21:30:25.998ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 433 local_addr = [fd00:1122:3344:101::1]:33745 method = GET remote_addr = [fd00:1122:3344:101::d]:65049 req_id = 877002e1-f015-4e5f-a6c5-095a3828b158 response_code = 200 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 uri = /3196594c-bc4a-474e-a0a2-7a0af521e0d4
15872024-06-12T21:30:30.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35317
15882024-06-12T21:30:30.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35317 req_id = f080954a-0f0c-4220-82cb-736fc2a4c077 response_code = 200 uri = /v2p
15892024-06-12T21:30:30.694ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57812
15902024-06-12T21:30:30.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57812 req_id = a45fdf94-681f-4ee6-813f-bcc380408978 response_code = 200 uri = /v2p
15912024-06-12T21:30:30.803ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53910
15922024-06-12T21:30:30.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47803 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53910 req_id = fe5e2e27-e05f-4771-9fcc-afca47097f45 response_code = 204 uri = /switch-ports
15932024-06-12T21:30:30.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34589
15942024-06-12T21:30:30.851ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57080
15952024-06-12T21:30:30.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34589 req_id = 4bbbf436-6f04-4b78-a110-d61dc49b42c3 response_code = 200 uri = /v2p
15962024-06-12T21:30:30.851ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53910 req_id = b2f26da1-5e56-4956-9eac-149b27075603 response_code = 200 uri = /network-bootstore-config
15972024-06-12T21:30:30.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46741 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57080 req_id = 850e7e24-4fd9-4f74-9d81-08826aa7c2f8 response_code = 204 uri = /switch-ports
15982024-06-12T21:30:30.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57080 req_id = 53e3f459-a94e-42e0-b003-7cc5bd3ce58f response_code = 200 uri = /network-bootstore-config
15992024-06-12T21:30:30.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63621
16002024-06-12T21:30:30.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63621 req_id = 7ff20e3b-c47f-457d-a090-4f52d3ecb31b response_code = 204 uri = /switch-ports
16012024-06-12T21:30:30.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63621 req_id = 242e61fb-e23b-4ace-b134-c001ff9397e0 response_code = 200 uri = /network-bootstore-config
16022024-06-12T21:30:48.252ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43831
16032024-06-12T21:30:48.252ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 63 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43831 req_id = 7cb38927-456c-4783-b6e8-53176bf044a9 response_code = 200 uri = /baseboard
16042024-06-12T21:30:55.999ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 828 local_addr = [fd00:1122:3344:101::1]:33745 method = GET remote_addr = [fd00:1122:3344:101::d]:65049 req_id = 8fc9de14-0ca8-4b03-9419-e8355a224464 response_code = 200 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 uri = /3196594c-bc4a-474e-a0a2-7a0af521e0d4
16052024-06-12T21:31:00.980ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61854
16062024-06-12T21:31:00.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61854 req_id = 22034eba-3f06-46d3-ae36-203befa973ee response_code = 200 uri = /v2p
16072024-06-12T21:31:01.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37344
16082024-06-12T21:31:01.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 766 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37344 req_id = 2a21de3f-f9f6-40ef-b9e4-a0307b316788 response_code = 200 uri = /v2p
16092024-06-12T21:31:01.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38023
16102024-06-12T21:31:01.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38023 req_id = 294646ce-9ce1-430c-bb67-1657ff65da5e response_code = 200 uri = /v2p
16112024-06-12T21:31:01.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63437
16122024-06-12T21:31:01.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49122 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63437 req_id = 33b94b99-a86c-4afa-98e8-6675f06556fe response_code = 204 uri = /switch-ports
16132024-06-12T21:31:01.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63437 req_id = b35217a3-27fd-49a3-b1de-888552bcafc2 response_code = 200 uri = /network-bootstore-config
16142024-06-12T21:31:01.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46875
16152024-06-12T21:31:01.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44951 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46875 req_id = 27e732ea-1667-4761-aa7e-f6c277b34267 response_code = 204 uri = /switch-ports
16162024-06-12T21:31:01.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46875 req_id = 655f3d72-6722-490e-89b7-95b9ce9a2bcd response_code = 200 uri = /network-bootstore-config
16172024-06-12T21:31:01.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38948
16182024-06-12T21:31:01.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43768 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38948 req_id = db04d557-4b53-4db4-ad45-ce84e3500578 response_code = 204 uri = /switch-ports
16192024-06-12T21:31:01.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38948 req_id = f9ac0cd0-f6f2-43ba-863b-ccc118e6d09e response_code = 200 uri = /network-bootstore-config
16202024-06-12T21:31:18.286ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46114
16212024-06-12T21:31:18.286ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46114 req_id = 3d9a063d-6637-4c2c-ac9b-bc664c63e81f response_code = 200 uri = /baseboard
16222024-06-12T21:31:25.999ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 482 local_addr = [fd00:1122:3344:101::1]:33745 method = GET remote_addr = [fd00:1122:3344:101::d]:65049 req_id = 141f8af6-5eae-4da4-a1ad-5502ecc30ad5 response_code = 200 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 uri = /3196594c-bc4a-474e-a0a2-7a0af521e0d4
16232024-06-12T21:31:30.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63976
16242024-06-12T21:31:30.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63976 req_id = 6e4f6845-66a6-4381-895b-5f2fff411516 response_code = 200 uri = /v2p
16252024-06-12T21:31:30.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51749
16262024-06-12T21:31:30.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51749 req_id = abe85a2b-0601-4a34-9db2-74a0a514fdfa response_code = 200 uri = /v2p
16272024-06-12T21:31:30.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59869
16282024-06-12T21:31:30.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59869 req_id = 8525b7f7-d766-4a8c-9479-b005efffa9f8 response_code = 200 uri = /v2p
16292024-06-12T21:31:30.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35127
16302024-06-12T21:31:31.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49299 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35127 req_id = f420335b-4842-486c-a4c6-d7df7c996d17 response_code = 204 uri = /switch-ports
16312024-06-12T21:31:31.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42352
16322024-06-12T21:31:31.037ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60052
16332024-06-12T21:31:31.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35127 req_id = c51f3d89-3421-4b1a-acb9-dfe9972119d5 response_code = 200 uri = /network-bootstore-config
16342024-06-12T21:31:31.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44382 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60052 req_id = 51509539-77d1-474b-b782-144242523439 response_code = 204 uri = /switch-ports
16352024-06-12T21:31:31.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60052 req_id = 90f9d3ad-7216-4748-938d-a43d4fdd9d0c response_code = 200 uri = /network-bootstore-config
16362024-06-12T21:31:31.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 88665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42352 req_id = 84c2245a-7253-4944-a1ef-90a94469e153 response_code = 204 uri = /switch-ports
16372024-06-12T21:31:31.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42352 req_id = 124d78bf-27cf-4503-a427-901ceebd60db response_code = 200 uri = /network-bootstore-config
16382024-06-12T21:31:48.317ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61285
16392024-06-12T21:31:48.318ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 93 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61285 req_id = 58042f42-8b1f-4802-994e-fe379b25069b response_code = 200 uri = /baseboard
16402024-06-12T21:31:56.020ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 814 local_addr = [fd00:1122:3344:101::1]:33745 method = GET remote_addr = [fd00:1122:3344:101::d]:65049 req_id = 63d4e995-2f01-467f-b3eb-588c1c347af6 response_code = 200 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 uri = /3196594c-bc4a-474e-a0a2-7a0af521e0d4
16412024-06-12T21:32:00.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65189
16422024-06-12T21:32:00.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1368 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65189 req_id = 4910968e-5276-44b2-9900-f87521dd1c46 response_code = 200 uri = /v2p
16432024-06-12T21:32:00.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44776
16442024-06-12T21:32:00.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44776 req_id = 27e37fb1-966d-4024-b0f6-aeaef762f69b response_code = 200 uri = /v2p
16452024-06-12T21:32:00.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49837
16462024-06-12T21:32:00.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 897 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49837 req_id = 8fb429c2-a38e-4392-afb5-241b0d803c26 response_code = 200 uri = /v2p
16472024-06-12T21:32:01.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48715
16482024-06-12T21:32:01.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47632 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48715 req_id = 0fe7cc1b-f21e-4af7-8448-78cf64a2ed35 response_code = 204 uri = /switch-ports
16492024-06-12T21:32:01.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59115
16502024-06-12T21:32:01.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48733
16512024-06-12T21:32:01.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48715 req_id = 92e4585f-b98f-4328-899b-fcbc5392dff1 response_code = 200 uri = /network-bootstore-config
16522024-06-12T21:32:01.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45866 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48733 req_id = ca231719-36a3-48e4-bbd6-0bcb36f871c7 response_code = 204 uri = /switch-ports
16532024-06-12T21:32:01.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48733 req_id = 587bf76a-aa30-4288-bce6-5d71c205ed1c response_code = 200 uri = /network-bootstore-config
16542024-06-12T21:32:01.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 92339 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59115 req_id = 4899edf3-a693-4931-a61e-d95f15182687 response_code = 204 uri = /switch-ports
16552024-06-12T21:32:01.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59115 req_id = c2875491-e936-49e6-a4e7-7eb1e8af4e66 response_code = 200 uri = /network-bootstore-config
16562024-06-12T21:32:11.956ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:300
16572024-06-12T21:32:11.956ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
16582024-06-12T21:32:11.996ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 1914, tv_nsec: 356730763 } time_to_next_cleanup = 599.999994209s
16592024-06-12T21:32:18.351ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52524
16602024-06-12T21:32:18.351ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 107 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52524 req_id = 03de2209-6d97-4818-a7b3-24aa75892afe response_code = 200 uri = /baseboard
16612024-06-12T21:32:26.059ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 491 local_addr = [fd00:1122:3344:101::1]:33745 method = GET remote_addr = [fd00:1122:3344:101::d]:65049 req_id = 13d3fd5c-5175-406a-9182-31ec47cc58d5 response_code = 200 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 uri = /3196594c-bc4a-474e-a0a2-7a0af521e0d4
16622024-06-12T21:32:30.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61163
16632024-06-12T21:32:30.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61163 req_id = e4410a64-84fe-4f53-8ea5-4fd1b9918b94 response_code = 200 uri = /v2p
16642024-06-12T21:32:30.709ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64608
16652024-06-12T21:32:30.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64608 req_id = eb58e88f-29f1-46bf-b873-320fd92ad20e response_code = 200 uri = /v2p
16662024-06-12T21:32:30.738ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52714
16672024-06-12T21:32:30.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52714 req_id = 7eb4a549-66e2-4a9a-92a5-51867a2404fb response_code = 200 uri = /v2p
16682024-06-12T21:32:30.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41329
16692024-06-12T21:32:30.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45479 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41329 req_id = 04dc5d13-96f1-4ebc-a8b0-faaec416dc1e response_code = 204 uri = /switch-ports
16702024-06-12T21:32:30.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48751
16712024-06-12T21:32:30.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 2763 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41329 req_id = de59082c-5697-4cbc-b23b-63baeed86ca3 response_code = 200 uri = /network-bootstore-config
16722024-06-12T21:32:30.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48751 req_id = abc71db2-0dae-42bb-8dcb-3a0282fb4abf response_code = 204 uri = /switch-ports
16732024-06-12T21:32:30.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48751 req_id = 3577aa2a-230a-406a-ae9c-29398cd5eaad response_code = 200 uri = /network-bootstore-config
16742024-06-12T21:32:30.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63201
16752024-06-12T21:32:31.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63201 req_id = 0f22eec2-1cdd-4262-9966-bdf7dfa7fea0 response_code = 204 uri = /switch-ports
16762024-06-12T21:32:31.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63201 req_id = 0e100cdc-bb30-41c6-9942-a62683ce5017 response_code = 200 uri = /network-bootstore-config
16772024-06-12T21:32:32.659ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
16782024-06-12T21:32:48.382ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52740
16792024-06-12T21:32:48.382ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 86 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52740 req_id = 6c10cc3e-1900-4d02-bcb2-05fc8229dfcb response_code = 200 uri = /baseboard
16802024-06-12T21:32:56.060ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1101 local_addr = [fd00:1122:3344:101::1]:33745 method = GET remote_addr = [fd00:1122:3344:101::d]:65049 req_id = 988a1688-2e61-4671-9cc9-fd359171b91a response_code = 200 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 uri = /3196594c-bc4a-474e-a0a2-7a0af521e0d4
16812024-06-12T21:33:00.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37095
16822024-06-12T21:33:00.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37095 req_id = 73886cc2-4a1c-4743-8e4c-d836e4bb3331 response_code = 200 uri = /v2p
16832024-06-12T21:33:00.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38490
16842024-06-12T21:33:00.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38490 req_id = c78b1226-5a6a-41e8-ab04-778e7bf581b2 response_code = 200 uri = /v2p
16852024-06-12T21:33:00.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62485
16862024-06-12T21:33:00.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62485 req_id = 7a9456a5-8ec6-4b6e-b9bf-59ff1a54e7cc response_code = 200 uri = /v2p
16872024-06-12T21:33:00.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51006
16882024-06-12T21:33:00.944ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f3f370-9025-4e91-be90-414e2843437b, kind: Service { id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf }, name: Name("external-dns-2104361f-f28a-4d05-9bef-d2bf9cc7accf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ba8d2a2b-5248-4f73-bcdc-4bb653022a9a, kind: Service { id: c848ab67-c488-4921-ac9a-d662e7f440af }, name: Name("external-dns-c848ab67-c488-4921-ac9a-d662e7f440af"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd82f45-f470-440f-b370-dc9e81aa749f, kind: Service { id: f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f }, name: Name("nexus-f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 198f5fa6-958e-4232-ac5f-5702fc084029, kind: Service { id: e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 }, name: Name("nexus-e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 179])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 28dc4374-c469-46f9-a3ff-03ae425af71b, kind: Service { id: 3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 }, name: Name("nexus-3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16892024-06-12T21:33:00.945ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16902024-06-12T21:33:00.945ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16912024-06-12T21:33:00.945ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16922024-06-12T21:33:00.945ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
16932024-06-12T21:33:00.945ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16942024-06-12T21:33:00.945ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16952024-06-12T21:33:00.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51006 req_id = 69373602-3043-42f6-b31b-5ed7bc4c8e09 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16962024-06-12T21:33:00.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38731
16972024-06-12T21:33:00.996ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f3f370-9025-4e91-be90-414e2843437b, kind: Service { id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf }, name: Name("external-dns-2104361f-f28a-4d05-9bef-d2bf9cc7accf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ba8d2a2b-5248-4f73-bcdc-4bb653022a9a, kind: Service { id: c848ab67-c488-4921-ac9a-d662e7f440af }, name: Name("external-dns-c848ab67-c488-4921-ac9a-d662e7f440af"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd82f45-f470-440f-b370-dc9e81aa749f, kind: Service { id: f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f }, name: Name("nexus-f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 198f5fa6-958e-4232-ac5f-5702fc084029, kind: Service { id: e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 }, name: Name("nexus-e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 179])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 28dc4374-c469-46f9-a3ff-03ae425af71b, kind: Service { id: 3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 }, name: Name("nexus-3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16982024-06-12T21:33:00.996ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16992024-06-12T21:33:00.997ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17002024-06-12T21:33:00.997ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17012024-06-12T21:33:00.997ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17022024-06-12T21:33:00.997ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17032024-06-12T21:33:00.997ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17042024-06-12T21:33:00.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38731 req_id = 93b5d489-3432-4ce7-925b-525d7d8f5bd8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17052024-06-12T21:33:01.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63623
17062024-06-12T21:33:01.086ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:524 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b0f3f370-9025-4e91-be90-414e2843437b, kind: Service { id: 2104361f-f28a-4d05-9bef-d2bf9cc7accf }, name: Name("external-dns-2104361f-f28a-4d05-9bef-d2bf9cc7accf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 246, 25])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: ba8d2a2b-5248-4f73-bcdc-4bb653022a9a, kind: Service { id: c848ab67-c488-4921-ac9a-d662e7f440af }, name: Name("external-dns-c848ab67-c488-4921-ac9a-d662e7f440af"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 139, 94])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0cd82f45-f470-440f-b370-dc9e81aa749f, kind: Service { id: f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f }, name: Name("nexus-f8fac050-0f8c-4ec0-81e8-fa2c6f1dae5f"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 194, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 198f5fa6-958e-4232-ac5f-5702fc084029, kind: Service { id: e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51 }, name: Name("nexus-e5a3c8b3-1d31-4d8e-8ffa-7d8afdab9f51"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 179])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }, NetworkInterface { id: 28dc4374-c469-46f9-a3ff-03ae425af71b, kind: Service { id: 3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7 }, name: Name("nexus-3af22f72-8fb1-4f56-9ae5-6c7c29ca5fb7"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 123])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17072024-06-12T21:33:01.086ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17082024-06-12T21:33:01.086ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17092024-06-12T21:33:01.086ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17102024-06-12T21:33:01.086ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte0" rules = []
17112024-06-12T21:33:01.086ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17122024-06-12T21:33:01.086ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:543 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17132024-06-12T21:33:01.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63623 req_id = b9e98989-f18b-4886-b183-8c5124753de1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17142024-06-12T21:33:01.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35149
17152024-06-12T21:33:01.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45921 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35149 req_id = 3706690f-79cc-465d-abb1-5d279b3b7bfd response_code = 204 uri = /switch-ports
17162024-06-12T21:33:01.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35149 req_id = 9be284ab-9a47-4cb7-aba6-47c09fadfe1f response_code = 200 uri = /network-bootstore-config
17172024-06-12T21:33:01.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34720
17182024-06-12T21:33:01.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44662 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34720 req_id = a4df2fc0-a899-411c-a5d1-9049fe5aab1f response_code = 204 uri = /switch-ports
17192024-06-12T21:33:01.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34720 req_id = 77c1138d-9986-462e-ad30-3e3ea61ae5f4 response_code = 200 uri = /network-bootstore-config
17202024-06-12T21:33:01.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40906
17212024-06-12T21:33:01.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43647 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40906 req_id = dcfa8adf-dde1-4fbb-abed-0d50e6aaa28e response_code = 204 uri = /switch-ports
17222024-06-12T21:33:01.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 767 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40906 req_id = c31814d5-8340-4801-8f07-fd32eacc7271 response_code = 200 uri = /network-bootstore-config
17232024-06-12T21:33:18.413ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45111
17242024-06-12T21:33:18.413ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 69 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45111 req_id = f97f9c36-e01b-45d0-83e4-c18d6d723cc5 response_code = 200 uri = /baseboard
17252024-06-12T21:33:26.060ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1098 local_addr = [fd00:1122:3344:101::1]:33745 method = GET remote_addr = [fd00:1122:3344:101::d]:65049 req_id = b4e4c4cd-3b4e-4fff-be7a-a7b84f682ee4 response_code = 200 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 uri = /3196594c-bc4a-474e-a0a2-7a0af521e0d4
17262024-06-12T21:33:30.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59862
17272024-06-12T21:33:30.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59862 req_id = bfc334cd-4fde-4df1-b3c1-283af5613d89 response_code = 200 uri = /v2p
17282024-06-12T21:33:30.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40015
17292024-06-12T21:33:30.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40015 req_id = 26f0b5ac-0538-44a0-b09b-01ac6e7009ee response_code = 200 uri = /v2p
17302024-06-12T21:33:30.734ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52123
17312024-06-12T21:33:30.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 876 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52123 req_id = 1b853a65-2bf4-4907-b8e5-46ea990ac351 response_code = 200 uri = /v2p
17322024-06-12T21:33:30.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53773
17332024-06-12T21:33:30.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53773 req_id = 8eefa0fb-9dc6-4b35-b8c7-36fa4a9f39d3 response_code = 204 uri = /switch-ports
17342024-06-12T21:33:30.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38148
17352024-06-12T21:33:30.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44839
17362024-06-12T21:33:30.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53773 req_id = 1177959e-38d6-4516-b422-7d57051543ec response_code = 200 uri = /network-bootstore-config
17372024-06-12T21:33:30.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44565 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38148 req_id = a6b4b779-466f-478b-adb8-89204fef5d2a response_code = 204 uri = /switch-ports
17382024-06-12T21:33:30.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 434 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38148 req_id = 78cc54b6-75f3-49f3-9d43-42c7068dc8ed response_code = 200 uri = /network-bootstore-config
17392024-06-12T21:33:31.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 90395 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44839 req_id = 6cba2033-0437-405e-afa6-60f6df8b21d9 response_code = 204 uri = /switch-ports
17402024-06-12T21:33:31.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44839 req_id = 1800bce7-1eb3-432f-8430-cece49bdea8c response_code = 200 uri = /network-bootstore-config
17412024-06-12T21:33:39.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42875
17422024-06-12T21:33:39.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42875 req_id = 86d10cce-538e-4c60-a18b-02616e8ebc3f response_code = 200 uri = /v2p
17432024-06-12T21:33:39.274ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:631 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 242, 34, 184])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9384120) }
17442024-06-12T21:33:39.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1348 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42875 req_id = e675ca03-3267-4eea-99d2-269a04c83184 response_code = 204 uri = /v2p
17452024-06-12T21:33:39.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40710
17462024-06-12T21:33:39.439ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:546 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: fa1d5a11-0806-4364-a5f7-b9104eff71dc, kind: Instance { id: 2365ab40-1902-4916-95ba-6881865869de }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 242, 34, 184])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9384120), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: fa1d5a11-0806-4364-a5f7-b9104eff71dc, kind: Instance { id: 2365ab40-1902-4916-95ba-6881865869de }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 242, 34, 184])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9384120), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: fa1d5a11-0806-4364-a5f7-b9104eff71dc, kind: Instance { id: 2365ab40-1902-4916-95ba-6881865869de }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 242, 34, 184])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9384120), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(9384120))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: fa1d5a11-0806-4364-a5f7-b9104eff71dc, kind: Instance { id: 2365ab40-1902-4916-95ba-6881865869de }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 242, 34, 184])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9384120), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-1618e7bd89d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 1a2497ab-b2ea-4088-92d9-49f9727529b3, read_only_parent: Some(Volume { block_size: 512, id: 88a3bafd-789c-4c7b-ba87-114cd6204409, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 254eb5a2-aeae-4c8b-b2e3-c209d07fd6b5, key: Some("8QiAbmwEVMZOkniGUx1IOPLp2xvr83jP55QwFuoaHZo="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1a2497ab-b2ea-4088-92d9-49f9727529b3, key: Some("cSiQhbfnUklNY6S3+6/54gpaKpt4blGjAiRboBKg6m8="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19003", "[fd00:1122:3344:101::16]:19003", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAACKM6zMWMxYAAAzrMxYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAijOszFjMWAAAM6zMWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIyMzY1YWI0MC0xOTAyLTQ5MTYtOTViYS02ODgxODY1ODY5ZGUiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTmJKU2RjR1VwTkNsTjF1bWIwMTd2OWwrNW1DVXU5YldOMmlmL3pETXAxVCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = 2365ab40-1902-4916-95ba-6881865869de instance_runtime = InstanceRuntimeState { propolis_id: Some(79529217-6ef6-4a01-a3e4-861b385df586), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-12T21:33:39.056581871Z } metadata = InstanceMetadata { silo_id: 4cf32c39-a235-4d40-8a70-f2eba8b36798, project_id: 736b7e89-f3f3-4838-a4c7-0d29a4274cf8 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 79529217-6ef6-4a01-a3e4-861b385df586 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-12T21:33:39.025142Z }
17472024-06-12T21:33:39.439ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:580 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17482024-06-12T21:33:39.440ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:938 instance_id = 2365ab40-1902-4916-95ba-6881865869de propolis_id = 79529217-6ef6-4a01-a3e4-861b385df586 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: fa1d5a11-0806-4364-a5f7-b9104eff71dc, kind: Instance { id: 2365ab40-1902-4916-95ba-6881865869de }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 242, 34, 184])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9384120), primary: true, slot: 0 }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: fa1d5a11-0806-4364-a5f7-b9104eff71dc, kind: Instance { id: 2365ab40-1902-4916-95ba-6881865869de }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 242, 34, 184])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9384120), primary: true, slot: 0 }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: fa1d5a11-0806-4364-a5f7-b9104eff71dc, kind: Instance { id: 2365ab40-1902-4916-95ba-6881865869de }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 242, 34, 184])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9384120), primary: true, slot: 0 }], filter_hosts: Some([Vpc(Vni(9384120))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: fa1d5a11-0806-4364-a5f7-b9104eff71dc, kind: Instance { id: 2365ab40-1902-4916-95ba-6881865869de }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 242, 34, 184])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9384120), primary: true, slot: 0 }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-1618e7bd89d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 1a2497ab-b2ea-4088-92d9-49f9727529b3, read_only_parent: Some(Volume { block_size: 512, id: 88a3bafd-789c-4c7b-ba87-114cd6204409, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 254eb5a2-aeae-4c8b-b2e3-c209d07fd6b5, key: Some("8QiAbmwEVMZOkniGUx1IOPLp2xvr83jP55QwFuoaHZo="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1a2497ab-b2ea-4088-92d9-49f9727529b3, key: Some("cSiQhbfnUklNY6S3+6/54gpaKpt4blGjAiRboBKg6m8="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19003", "[fd00:1122:3344:101::16]:19003", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAACKM6zMWMxYAAAzrMxYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAijOszFjMWAAAM6zMWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIyMzY1YWI0MC0xOTAyLTQ5MTYtOTViYS02ODgxODY1ODY5ZGUiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTmJKU2RjR1VwTkNsTjF1bWIwMTd2OWwrNW1DVXU5YldOMmlmL3pETXAxVCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(79529217-6ef6-4a01-a3e4-861b385df586), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-12T21:33:39.056581871Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-12T21:33:39.025142Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
17492024-06-12T21:33:39.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 21038 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40710 req_id = ec25b10a-52dd-403c-892c-5a4fa71b64b4 response_code = 200 uri = /instances/2365ab40-1902-4916-95ba-6881865869de
17502024-06-12T21:33:39.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65039
17512024-06-12T21:33:39.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 2267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65039 req_id = 6a490c00-5e79-48e1-9d89-d755f6132f80 response_code = 200 uri = /instances/2365ab40-1902-4916-95ba-6881865869de/state
17522024-06-12T21:33:39.598ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:393 port = Port { inner: PortInner { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 242, 34, 184]), slot: 0, vni: Vni { inner: 9384120 }, gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" } }
17532024-06-12T21:33:39.598ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17542024-06-12T21:33:39.632ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586 file = illumos-utils/src/zone.rs:315 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17552024-06-12T21:33:39.653ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586 file = illumos-utils/src/zone.rs:354 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17562024-06-12T21:33:41.213ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::b]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17572024-06-12T21:33:41.214ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = 2365ab40-1902-4916-95ba-6881865869de zone = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17582024-06-12T21:33:41.401ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 44.399847ms file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de zone = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17592024-06-12T21:33:41.454ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 60.220737ms file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de zone = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17602024-06-12T21:33:41.531ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 243.222669ms file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de zone = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17612024-06-12T21:33:41.792ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 392.025579ms file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de zone = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17622024-06-12T21:33:42.198ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 963.245553ms file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de zone = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17632024-06-12T21:33:43.173ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 1.313099606s file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de zone = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17642024-06-12T21:33:44.496ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 1.055406896s file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de zone = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17652024-06-12T21:33:45.562ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 980.824192ms file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de zone = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17662024-06-12T21:33:46.573ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586 file = sled-agent/src/instance.rs:1423 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17672024-06-12T21:33:46.581ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 30.084235ms file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17682024-06-12T21:33:46.621ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 133.400427ms file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17692024-06-12T21:33:46.764ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586") failed: Property not found. retry in 165.701611ms file = illumos-utils/src/svc.rs:36 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17702024-06-12T21:33:46.941ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1432 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17712024-06-12T21:33:46.978ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1446 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17722024-06-12T21:33:46.978ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAACKM6zMWMxYAAAzrMxYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAijOszFjMWAAAM6zMWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiIyMzY1YWI0MC0xOTAyLTQ5MTYtOTViYS02ODgxODY1ODY5ZGUiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJTmJKU2RjR1VwTkNsTjF1bWIwMTd2OWwrNW1DVXU5YldOMmlmL3pETXAxVCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-1618e7bd89d", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 1a2497ab-b2ea-4088-92d9-49f9727529b3, read_only_parent: Some(Volume { block_size: 512, id: 88a3bafd-789c-4c7b-ba87-114cd6204409, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 254eb5a2-aeae-4c8b-b2e3-c209d07fd6b5, key: Some("8QiAbmwEVMZOkniGUx1IOPLp2xvr83jP55QwFuoaHZo="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::16]:19002", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 1a2497ab-b2ea-4088-92d9-49f9727529b3, key: Some("cSiQhbfnUklNY6S3+6/54gpaKpt4blGjAiRboBKg6m8="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::12]:19003", "[fd00:1122:3344:101::16]:19003", "[fd00:1122:3344:101::14]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: 2365ab40-1902-4916-95ba-6881865869de, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 736b7e89-f3f3-4838-a4c7-0d29a4274cf8, silo_id: 4cf32c39-a235-4d40-8a70-f2eba8b36798 }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:685 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17732024-06-12T21:33:47.161ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:687 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17742024-06-12T21:33:47.163ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-06-12T21:33:47.161899850Z } file = sled-agent/src/instance.rs:569 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17752024-06-12T21:33:47.163ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 2365ab40-1902-4916-95ba-6881865869de new_instance_state = InstanceRuntimeState { propolis_id: Some(79529217-6ef6-4a01-a3e4-861b385df586), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-12T21:33:39.056581871Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-12T21:33:47.161899850Z } propolis_id = 79529217-6ef6-4a01-a3e4-861b385df586
17762024-06-12T21:33:47.163ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 2365ab40-1902-4916-95ba-6881865869de state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(79529217-6ef6-4a01-a3e4-861b385df586), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-12T21:33:39.056581871Z }, propolis_id: 79529217-6ef6-4a01-a3e4-861b385df586, vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-12T21:33:47.161899850Z }, migration_state: None }
17772024-06-12T21:33:47.267ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-06-12T21:33:47.267952750Z } file = sled-agent/src/instance.rs:569 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17782024-06-12T21:33:47.267ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 2365ab40-1902-4916-95ba-6881865869de new_instance_state = InstanceRuntimeState { propolis_id: Some(79529217-6ef6-4a01-a3e4-861b385df586), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-12T21:33:39.056581871Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-12T21:33:47.267952750Z } propolis_id = 79529217-6ef6-4a01-a3e4-861b385df586
17792024-06-12T21:33:47.268ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 2365ab40-1902-4916-95ba-6881865869de state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(79529217-6ef6-4a01-a3e4-861b385df586), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-12T21:33:39.056581871Z }, propolis_id: 79529217-6ef6-4a01-a3e4-861b385df586, vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-12T21:33:47.267952750Z }, migration_state: None }
17802024-06-12T21:33:48.448ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45964
17812024-06-12T21:33:48.448ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45964 req_id = 6b3d88a1-14f3-4ed7-80d3-d1cd9b0199b9 response_code = 200 uri = /baseboard
17822024-06-12T21:33:56.060ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 570 local_addr = [fd00:1122:3344:101::1]:33745 method = GET remote_addr = [fd00:1122:3344:101::d]:65049 req_id = ac4a94a3-7ea6-467e-8037-6ab6bdd0fd7d response_code = 200 sled_id = 3196594c-bc4a-474e-a0a2-7a0af521e0d4 uri = /3196594c-bc4a-474e-a0a2-7a0af521e0d4
17832024-06-12T21:33:56.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34370
17842024-06-12T21:33:56.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 468 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34370 req_id = b4a7dba9-b910-47ad-9b9b-e24e52209be3 response_code = 200 uri = /instances/2365ab40-1902-4916-95ba-6881865869de/state
17852024-06-12T21:33:56.516ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-06-12T21:33:56.516923365Z } file = sled-agent/src/instance.rs:569 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17862024-06-12T21:33:56.516ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 2365ab40-1902-4916-95ba-6881865869de new_instance_state = InstanceRuntimeState { propolis_id: Some(79529217-6ef6-4a01-a3e4-861b385df586), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-12T21:33:39.056581871Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-12T21:33:56.516923365Z } propolis_id = 79529217-6ef6-4a01-a3e4-861b385df586
17872024-06-12T21:33:56.516ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 2365ab40-1902-4916-95ba-6881865869de state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(79529217-6ef6-4a01-a3e4-861b385df586), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-12T21:33:39.056581871Z }, propolis_id: 79529217-6ef6-4a01-a3e4-861b385df586, vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-12T21:33:56.516923365Z }, migration_state: None }
17882024-06-12T21:33:56.535ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-06-12T21:33:56.535074481Z } file = sled-agent/src/instance.rs:569 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17892024-06-12T21:33:56.535ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:591 instance_id = 2365ab40-1902-4916-95ba-6881865869de new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-12T21:33:56.535074481Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-06-12T21:33:56.535074481Z } propolis_id = 79529217-6ef6-4a01-a3e4-861b385df586
17902024-06-12T21:33:56.535ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:606 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17912024-06-12T21:33:56.535ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17922024-06-12T21:33:56.535ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:381
17932024-06-12T21:33:56.535ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/64bf9acf-c302-41ed-8452-f61f55d2f45f/debug/bundle/zone", "/pool/int/e0099430-147d-4db6-a892-0d1b36d80310/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/fdc5c351-bd0c-490e-a824-bb2f2b967954/crypt/debug", "/pool/ext/15994f92-33d0-4f72-971d-e91c145bfd50/crypt/debug", "/pool/ext/a460ece5-fa75-4a2f-9cbe-a135dc5396ce/crypt/debug", "/pool/ext/163451ca-17b3-4f83-ab53-55a998e6b8c3/crypt/debug", "/pool/ext/8043b355-0fd3-40fc-8db4-22fae40be7a4/crypt/debug", "/pool/ext/1fdc26fb-b263-4c2f-8644-ca7d8d273b44/crypt/debug", "/pool/ext/23b2d7a5-435a-444f-8b3c-4170f8f73f40/crypt/debug", "/pool/ext/23f948a5-169f-4744-8cb4-c0ecf022e665/crypt/debug", "/pool/ext/70df896f-091c-40a3-a0c4-31293f39c2cc/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586
17942024-06-12T21:33:57.165ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586", bundle_id: 13f9dc5c-f9a7-4b3c-acd6-ab42ce1dc498 }, time_created: 2024-06-12T21:33:56.535829470Z, version: 0, cause: TerminatedInstance }
17952024-06-12T21:33:57.165ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_79529217-6ef6-4a01-a3e4-861b385df586 file = sled-agent/src/instance.rs:780 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17962024-06-12T21:33:58.928ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = 2365ab40-1902-4916-95ba-6881865869de
17972024-06-12T21:33:58.959ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 2365ab40-1902-4916-95ba-6881865869de state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-12T21:33:56.535074481Z }, propolis_id: 79529217-6ef6-4a01-a3e4-861b385df586, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-12T21:33:58.959708915Z }, migration_state: None }
17982024-06-12T21:33:59.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36167
17992024-06-12T21:33:59.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 742 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36167 req_id = 14c1aded-7dcf-48dc-af05-cc2e43134f8a response_code = 200 uri = /v2p
18002024-06-12T21:33:59.331ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:491 instance_id = 2365ab40-1902-4916-95ba-6881865869de state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-12T21:33:56.535074481Z }, propolis_id: 79529217-6ef6-4a01-a3e4-861b385df586, vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-12T21:33:58.959708915Z }, migration_state: None }
18012024-06-12T21:33:59.334ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:723 instance_id = 2365ab40-1902-4916-95ba-6881865869de
18022024-06-12T21:34:00.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52062
18032024-06-12T21:34:00.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52062 req_id = 857c51f7-eea5-46cd-b71d-e962508b277f response_code = 200 uri = /v2p
18042024-06-12T21:34:00.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45489
18052024-06-12T21:34:00.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45489 req_id = 51b5a0f9-a51d-4932-96c0-6ddd726f5596 response_code = 200 uri = /v2p
18062024-06-12T21:34:00.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65232
18072024-06-12T21:34:00.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65232 req_id = 345f550c-9cc4-4064-89e2-6ca36b0fa27b response_code = 200 uri = /v2p
18082024-06-12T21:34:00.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39867
18092024-06-12T21:34:00.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39867 req_id = 7a9e335a-64b7-402d-aa05-4346f547c24b response_code = 200 uri = /v2p
18102024-06-12T21:34:01.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51882
18112024-06-12T21:34:01.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51882 req_id = 6a626cac-062c-49b1-987c-f3bf561b3be8 response_code = 204 uri = /switch-ports
18122024-06-12T21:34:01.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53175
18132024-06-12T21:34:01.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3363 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51882 req_id = 8adcd11c-a3d3-4bdb-bbae-af9d641f2c40 response_code = 200 uri = /network-bootstore-config
18142024-06-12T21:34:01.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62909
18152024-06-12T21:34:01.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46188 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53175 req_id = 6f9f95b9-93a5-403a-bb8f-9122d11cebe7 response_code = 204 uri = /switch-ports
18162024-06-12T21:34:01.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 572 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53175 req_id = 7848af5d-bfb6-488d-b38b-c8d531021878 response_code = 200 uri = /network-bootstore-config
18172024-06-12T21:34:01.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 56250 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62909 req_id = 50c5b8fe-b5e0-46ba-a6b2-fe5803964360 response_code = 204 uri = /switch-ports
18182024-06-12T21:34:01.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62909 req_id = 649cb3ea-0b7c-45e7-b6b7-be24b9272615 response_code = 200 uri = /network-bootstore-config