Max level shown:
1 [ Aug 27 18:59:13 Enabled. ]
2 [ Aug 27 18:59:13 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Aug 27 18:59:13 Method "start" exited with status 0. ]
4 [ Aug 27 18:59:13 Rereading configuration. ]
5 [ Aug 27 18:59:13 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-08-27T18:59:13.173ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82024-08-27T18:59:13.174ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-08-27T18:59:13.226ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-08-27T18:59:13.226ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-08-27T18:59:13.339ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-08-27T18:59:13.348ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-08-27T18:59:13.357ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-08-27T18:59:13.962ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152024-08-27T18:59:14.107ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162024-08-27T18:59:14.108ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172024-08-27T18:59:14.108ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182024-08-27T18:59:14.108ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-08-27T18:59:14.108ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202024-08-27T18:59:14.108ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:716
212024-08-27T18:59:14.111ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:623
222024-08-27T18:59:14.111ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:765
232024-08-27T18:59:14.111ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242024-08-27T18:59:14.111ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:824
252024-08-27T18:59:14.111ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262024-08-27T18:59:14.111ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-08-27T18:59:14.111ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
282024-08-27T18:59:14.111ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-08-27T18:59:14.111ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-08-27T18:59:14.123ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:360
312024-08-27T18:59:14.123ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool)
322024-08-27T18:59:14.228ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal }
332024-08-27T18:59:14.435ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:406
342024-08-27T18:59:14.435ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352024-08-27T18:59:14.435ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-08-27T18:59:14.435ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-08-27T18:59:14.435ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
382024-08-27T18:59:14.435ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-08-27T18:59:14.435ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-08-27T18:59:14.443ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:360
412024-08-27T18:59:14.443ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:371 id = b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool)
422024-08-27T18:59:14.532ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal }
432024-08-27T18:59:14.732ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442024-08-27T18:59:14.732ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462024-08-27T18:59:14.732ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
472024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482024-08-27T18:59:14.732ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-08-27T18:59:14.732ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502024-08-27T18:59:14.732ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532024-08-27T18:59:14.732ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
542024-08-27T18:59:14.732ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-08-27T18:59:14.732ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562024-08-27T18:59:14.732ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
572024-08-27T18:59:14.732ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582024-08-27T18:59:14.732ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612024-08-27T18:59:14.732ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622024-08-27T18:59:14.732ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652024-08-27T18:59:14.732ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
662024-08-27T18:59:14.732ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672024-08-27T18:59:14.732ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682024-08-27T18:59:14.732ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712024-08-27T18:59:14.732ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
722024-08-27T18:59:14.732ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-08-27T18:59:14.732ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742024-08-27T18:59:14.732ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
752024-08-27T18:59:14.732ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
762024-08-27T18:59:14.732ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792024-08-27T18:59:14.732ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802024-08-27T18:59:14.732ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822024-08-27T18:59:14.732ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832024-08-27T18:59:14.732ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
842024-08-27T18:59:14.732ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852024-08-27T18:59:14.732ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862024-08-27T18:59:14.732ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872024-08-27T18:59:14.733ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882024-08-27T18:59:14.733ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892024-08-27T18:59:14.733ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
902024-08-27T18:59:14.733ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912024-08-27T18:59:14.733ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922024-08-27T18:59:14.733ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
932024-08-27T18:59:14.733ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942024-08-27T18:59:14.733ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952024-08-27T18:59:14.733ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962024-08-27T18:59:14.733ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972024-08-27T18:59:14.733ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982024-08-27T18:59:14.733ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992024-08-27T18:59:14.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1002024-08-27T18:59:14.733ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012024-08-27T18:59:14.733ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022024-08-27T18:59:14.733ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032024-08-27T18:59:14.733ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042024-08-27T18:59:14.733ZINFOSledAgent (bootstore): No ledger in /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052024-08-27T18:59:14.733ZINFOSledAgent (bootstore): No ledger in /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062024-08-27T18:59:14.733ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072024-08-27T18:59:14.733ZINFOSledAgent (bootstore): No ledger in /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082024-08-27T18:59:14.733ZINFOSledAgent (bootstore): No ledger in /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092024-08-27T18:59:14.733ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102024-08-27T18:59:14.733ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112024-08-27T18:59:14.733ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122024-08-27T18:59:14.744ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:731
1132024-08-27T18:59:14.744ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1299, tv_nsec: 849225131 } time_to_next_cleanup = 599.999941369s
1142024-08-27T18:59:14.744ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3861
1152024-08-27T18:59:14.744ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1162024-08-27T18:59:14.744ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-08-27T18:59:14.746ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-08-27T18:59:14.747ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192024-08-27T18:59:14.747ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202024-08-27T18:59:14.747ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1053
1212024-08-27T18:59:14.747ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1222024-08-27T18:59:14.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1232024-08-27T18:59:14.747ZINFOSledAgent (RSS): No ledger in /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-08-27T18:59:14.747ZINFOSledAgent (RSS): No ledger in /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-08-27T18:59:14.747ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1113
1262024-08-27T18:59:14.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1272024-08-27T18:59:14.747ZINFOSledAgent (RSS): No ledger in /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-08-27T18:59:14.747ZINFOSledAgent (RSS): No ledger in /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-08-27T18:59:14.747ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1154
1302024-08-27T18:59:14.747ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:155
1312024-08-27T18:59:14.747ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:128
1322024-08-27T18:59:14.747ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1332024-08-27T18:59:14.747ZINFOSledAgent (RSS): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-08-27T18:59:14.748ZINFOSledAgent (RSS): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-08-27T18:59:14.748ZINFOSledAgent (RSS): Sled plan written to storage: Plan { rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, sleds: { [fdb0:18c0:4d0d:9fb2::1]:12346: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e38b401b-2d22-4589-ac73-fc644b0a15b2, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64, }, }, }, }, }, config: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, local_pref: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, }, } file = sled-agent/src/rack_setup/plan/sled.rs:175
1362024-08-27T18:59:14.748ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1187
1372024-08-27T18:59:14.748ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1382024-08-27T18:59:14.748ZINFOSledAgent (bootstore): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1392024-08-27T18:59:14.748ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1402024-08-27T18:59:14.749ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1412024-08-27T18:59:14.749ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e38b401b-2d22-4589-ac73-fc644b0a15b2, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1422024-08-27T18:59:14.749ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:53705
1432024-08-27T18:59:14.749ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e38b401b-2d22-4589-ac73-fc644b0a15b2, rack_id: c74aab71-8e38-4613-a469-5ba1cc230991, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:359
1442024-08-27T18:59:14.749ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:374
1452024-08-27T18:59:14.749ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:406
1462024-08-27T18:59:14.749ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1472024-08-27T18:59:14.749ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:574
1482024-08-27T18:59:14.749ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
1492024-08-27T18:59:14.749ZINFOSledAgent (StorageManager): No ledger in /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1502024-08-27T18:59:14.749ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1512024-08-27T18:59:14.749ZINFOSledAgent (StorageManager): No ledger in /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-08-27T18:59:14.749ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:563
1532024-08-27T18:59:14.749ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:591
1542024-08-27T18:59:14.749ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:395
1552024-08-27T18:59:14.749ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1562024-08-27T18:59:14.749ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:481 result = DisksManagementResult { status: [] }
1572024-08-27T18:59:14.751ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4158
1582024-08-27T18:59:14.751ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4540
1592024-08-27T18:59:14.780ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1602024-08-27T18:59:14.801ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:316
1612024-08-27T18:59:14.819ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1622024-08-27T18:59:14.827ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:385 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1632024-08-27T18:59:14.827ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1642024-08-27T18:59:14.827ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:397 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1652024-08-27T18:59:14.827ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1662024-08-27T18:59:14.830ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 61.313309ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d3f40de5-cfd9-4d58-a4b6-81c8411210da", "content-length": "124", "date": "Tue, 27 Aug 2024 18:59:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d3f40de5-cfd9-4d58-a4b6-81c8411210da" } file = clients/ddm-admin-client/src/lib.rs:177
1672024-08-27T18:59:14.841ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_861e54cf-f95e-47d9-b389-b519c9faa394/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1682024-08-27T18:59:14.865ZINFOSledAgent: successfully created encrypted zvol: name="oxi_861e54cf-f95e-47d9-b389-b519c9faa394/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1692024-08-27T18:59:14.865ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_861e54cf-f95e-47d9-b389-b519c9faa394/swap" file = sled-agent/src/swap_device.rs:96
1702024-08-27T18:59:14.870ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:412 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1712024-08-27T18:59:14.870ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1722024-08-27T18:59:14.870ZINFOSledAgent (BackingFs): Ensuring dataset oxi_861e54cf-f95e-47d9-b389-b519c9faa394/backing/fmd file = sled-agent/src/backing_fs.rs:136
1732024-08-27T18:59:14.892ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1742024-08-27T18:59:14.893ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 149.332776ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8fcc1ebf-395b-4242-bce2-4092ba7a96de", "content-length": "124", "date": "Tue, 27 Aug 2024 18:59:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8fcc1ebf-395b-4242-bce2-4092ba7a96de" } file = clients/ddm-admin-client/src/lib.rs:177
1752024-08-27T18:59:14.947ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1762024-08-27T18:59:15.044ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772024-08-27T18:59:15.045ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 73.361833ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "27c26666-9cf3-481d-a13e-0442be105ab4", "content-length": "124", "date": "Tue, 27 Aug 2024 18:59:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "27c26666-9cf3-481d-a13e-0442be105ab4" } file = clients/ddm-admin-client/src/lib.rs:177
1782024-08-27T18:59:15.119ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1792024-08-27T18:59:15.120ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 141.115524ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "83763717-1fa9-4825-9ee0-ce2dd291323d", "content-length": "124", "date": "Tue, 27 Aug 2024 18:59:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "83763717-1fa9-4825-9ee0-ce2dd291323d" } file = clients/ddm-admin-client/src/lib.rs:177
1802024-08-27T18:59:15.166ZINFOSledAgent (BackingFs): Mounting oxi_861e54cf-f95e-47d9-b389-b519c9faa394/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1812024-08-27T18:59:15.179ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1822024-08-27T18:59:15.179ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1832024-08-27T18:59:15.179ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1842024-08-27T18:59:15.179ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1852024-08-27T18:59:15.262ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-08-27T18:59:15.262ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 171.66185ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0264d780-d50c-4f05-a414-9df6c58d8d38", "content-length": "124", "date": "Tue, 27 Aug 2024 18:59:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0264d780-d50c-4f05-a414-9df6c58d8d38" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-08-27T18:59:15.435ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-08-27T18:59:15.436ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 306.790945ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "580ab5b8-b558-4eb9-b2a5-21e440ea8813", "content-length": "124", "date": "Tue, 27 Aug 2024 18:59:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "580ab5b8-b558-4eb9-b2a5-21e440ea8813" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-08-27T18:59:15.744ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1902024-08-27T18:59:15.744ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 375.80574ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "60d75f10-66f0-4d4e-a0ba-074920913783", "content-length": "124", "date": "Tue, 27 Aug 2024 18:59:15 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "60d75f10-66f0-4d4e-a0ba-074920913783" } file = clients/ddm-admin-client/src/lib.rs:177
1912024-08-27T18:59:15.911ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1922024-08-27T18:59:15.917ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:55586 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1932024-08-27T18:59:15.917ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1942024-08-27T18:59:15.917ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:55586 file = oximeter/producer/src/lib.rs:283 interval = 30s producer_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1952024-08-27T18:59:15.918ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 130.013636ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1962024-08-27T18:59:15.919ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1972024-08-27T18:59:15.919ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
1982024-08-27T18:59:15.919ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:915 underlay_address = fd00:1122:3344:101::1
1992024-08-27T18:59:15.919ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:73
2002024-08-27T18:59:16.051ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 669.144899ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
2012024-08-27T18:59:16.122ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022024-08-27T18:59:16.721ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.284417274s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
2032024-08-27T18:59:18.008ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.973129134s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
2042024-08-27T18:59:18.313ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2634
2052024-08-27T18:59:18.313ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2852
2062024-08-27T18:59:18.313ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2504
2072024-08-27T18:59:18.313ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2551
2082024-08-27T18:59:18.313ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2933
2092024-08-27T18:59:18.313ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2975
2102024-08-27T18:59:18.315ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2777
2112024-08-27T18:59:18.316ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2545
2122024-08-27T18:59:18.316ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='ebb2a803-5616-4818-8da9-8bbf88fa8737'/> <propval type="astring" name="rack_id" value='c74aab71-8e38-4613-a469-5ba1cc230991'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fec4:5b2c'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_id" value='e38b401b-2d22-4589-ac73-fc644b0a15b2'/> <propval type="astring" name="rack_id" value='c74aab71-8e38-4613-a469-5ba1cc230991'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='e38b401b-2d22-4589-ac73-fc644b0a15b2'/> <propval type="astring" name="rack_uuid" value='c74aab71-8e38-4613-a469-5ba1cc230991'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='e38b401b-2d22-4589-ac73-fc644b0a15b2'/> <propval type="astring" name="rack_uuid" value='c74aab71-8e38-4613-a469-5ba1cc230991'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2132024-08-27T18:59:18.316ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2142024-08-27T18:59:18.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 34.642452ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2152024-08-27T18:59:18.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 147.141882ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2162024-08-27T18:59:19.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 126.852995ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2172024-08-27T18:59:19.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 391.900653ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182024-08-27T18:59:19.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 478.967819ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192024-08-27T18:59:19.982ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.299458907s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
2202024-08-27T18:59:20.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.263016005s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212024-08-27T18:59:21.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 724.068992ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222024-08-27T18:59:22.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 758.774456ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232024-08-27T18:59:23.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.144668518s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242024-08-27T18:59:24.927ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:205 local_addr = [fd00:1122:3344:101::1]:12345
2252024-08-27T18:59:24.927ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:429
2262024-08-27T18:59:24.927ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2272024-08-27T18:59:24.927ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2282024-08-27T18:59:24.928ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2292024-08-27T18:59:24.928ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2302024-08-27T18:59:24.928ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, local_pref: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, lldp: None }], bgp: [], bfd: [] })))
2312024-08-27T18:59:24.928ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:53705
2322024-08-27T18:59:24.928ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3861
2332024-08-27T18:59:25.162ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2342024-08-27T18:59:25.162ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2352024-08-27T18:59:25.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2362024-08-27T18:59:25.162ZINFOSledAgent (RSS): No ledger in /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2372024-08-27T18:59:25.162ZINFOSledAgent (RSS): No ledger in /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/rss-service-plan-v4.json file = common/src/ledger.rs:188
2382024-08-27T18:59:25.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2392024-08-27T18:59:25.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2402024-08-27T18:59:25.162ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2412024-08-27T18:59:25.167ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4182 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422024-08-27T18:59:25.167ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4198
2432024-08-27T18:59:25.167ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442024-08-27T18:59:25.445ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 10.500269296s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:391 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
2452024-08-27T18:59:25.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39750
2462024-08-27T18:59:25.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2472024-08-27T18:59:25.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39750 req_id = d06b106a-0c45-4a59-9169-4c588f3eff05 response_code = 200 uri = /inventory
2482024-08-27T18:59:25.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35307
2492024-08-27T18:59:25.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35307 req_id = 176903f6-1abd-481a-a937-f7e36aae8d2e response_code = 200 uri = /sled-role
2502024-08-27T18:59:25.508ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2512024-08-27T18:59:25.508ZINFOSledAgent (RSS): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2522024-08-27T18:59:25.508ZINFOSledAgent (RSS): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/.rss-service-plan-v4.json.tmp file = common/src/ledger.rs:199
2532024-08-27T18:59:25.509ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:998
2542024-08-27T18:59:25.539ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9aefc2e2-db1c-4469-8a20-eb135de9e1d1, pool_id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 96b7ca80-7180-49d7-9dc6-acbaf172d09b, pool_id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 49f84811-cba8-4517-87b4-cc0fb15d64f4, pool_id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 67df2416-61bb-4cdc-b723-8624e8bdbaec, pool_id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 196d1a5e-d899-4e67-a2f7-f0a19c1b76f3, pool_id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: f6537384-c2f0-416e-a446-8d8a32908734, pool_id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6566063f-82da-400b-8563-c827df5f8949, pool_id: 030f20e2-2758-4a47-92fd-4adaf0953899 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 4301a630-9aa5-41b4-9bc0-ec1e01ca90f8, pool_id: a954bc02-0277-475f-b5f2-befa522b2371 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 24eb0820-c9c1-4921-a33f-197d8a637850, pool_id: c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:355 sled_address = [fd00:1122:3344:101::1]:12345
2552024-08-27T18:59:25.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38475
2562024-08-27T18:59:25.539ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:830 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
2572024-08-27T18:59:25.539ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9aefc2e2-db1c-4469-8a20-eb135de9e1d1, pool_id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 96b7ca80-7180-49d7-9dc6-acbaf172d09b, pool_id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 49f84811-cba8-4517-87b4-cc0fb15d64f4, pool_id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 67df2416-61bb-4cdc-b723-8624e8bdbaec, pool_id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 196d1a5e-d899-4e67-a2f7-f0a19c1b76f3, pool_id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: f6537384-c2f0-416e-a446-8d8a32908734, pool_id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 6566063f-82da-400b-8563-c827df5f8949, pool_id: 030f20e2-2758-4a47-92fd-4adaf0953899 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 4301a630-9aa5-41b4-9bc0-ec1e01ca90f8, pool_id: a954bc02-0277-475f-b5f2-befa522b2371 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 24eb0820-c9c1-4921-a33f-197d8a637850, pool_id: c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:406
2582024-08-27T18:59:25.539ZINFOSledAgent (StorageManager): No ledger in /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2592024-08-27T18:59:25.539ZINFOSledAgent (StorageManager): No ledger in /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2602024-08-27T18:59:25.539ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:645 request = omicron_physical_disks_ensure
2612024-08-27T18:59:25.539ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2622024-08-27T18:59:25.539ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2632024-08-27T18:59:25.539ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2642024-08-27T18:59:25.539ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2652024-08-27T18:59:25.660ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:360
2662024-08-27T18:59:25.660ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool)
2672024-08-27T18:59:26.106ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e38b401b-2d22-4589-ac73-fc644b0a15b2): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
2682024-08-27T18:59:26.303ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
2692024-08-27T18:59:26.352ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }
2702024-08-27T18:59:26.360ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:351
2712024-08-27T18:59:26.360ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:353
2722024-08-27T18:59:26.360ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:357
2732024-08-27T18:59:26.360ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:359
2742024-08-27T18:59:26.360ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2752024-08-27T18:59:26.360ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762024-08-27T18:59:26.360ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
2772024-08-27T18:59:26.395ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2782024-08-27T18:59:26.404ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_da7c3e21-7c55-491f-981e-80aa62a13bf6/crypt/zone file = sled-storage/src/dataset.rs:414
2792024-08-27T18:59:26.523ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_da7c3e21-7c55-491f-981e-80aa62a13bf6 file = sled-storage/src/dataset.rs:499
2802024-08-27T18:59:26.531ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2812024-08-27T18:59:26.531ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2822024-08-27T18:59:26.531ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2832024-08-27T18:59:26.531ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2842024-08-27T18:59:26.531ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2852024-08-27T18:59:26.541ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:360
2862024-08-27T18:59:26.541ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool)
2872024-08-27T18:59:26.634ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }
2882024-08-27T18:59:26.642ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:351
2892024-08-27T18:59:26.642ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:353
2902024-08-27T18:59:26.642ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:357
2912024-08-27T18:59:26.642ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:359
2922024-08-27T18:59:26.643ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2932024-08-27T18:59:26.643ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942024-08-27T18:59:26.643ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
2952024-08-27T18:59:26.681ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2962024-08-27T18:59:26.689ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e/crypt/zone file = sled-storage/src/dataset.rs:414
2972024-08-27T18:59:26.814ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e file = sled-storage/src/dataset.rs:499
2982024-08-27T18:59:26.822ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2992024-08-27T18:59:26.822ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3002024-08-27T18:59:26.822ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3012024-08-27T18:59:26.822ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3022024-08-27T18:59:26.822ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3032024-08-27T18:59:26.832ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:360
3042024-08-27T18:59:26.832ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool)
3052024-08-27T18:59:26.927ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }
3062024-08-27T18:59:26.935ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:351
3072024-08-27T18:59:26.935ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:353
3082024-08-27T18:59:26.935ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:357
3092024-08-27T18:59:26.935ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:359
3102024-08-27T18:59:26.935ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-08-27T18:59:26.936ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122024-08-27T18:59:26.936ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3132024-08-27T18:59:26.971ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3142024-08-27T18:59:26.979ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_558a4fa3-16b9-4e7c-8ac0-a40723ece2de/crypt/zone file = sled-storage/src/dataset.rs:414
3152024-08-27T18:59:27.108ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_558a4fa3-16b9-4e7c-8ac0-a40723ece2de file = sled-storage/src/dataset.rs:499
3162024-08-27T18:59:27.112ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e38b401b-2d22-4589-ac73-fc644b0a15b2): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
3172024-08-27T18:59:27.116ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3182024-08-27T18:59:27.116ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3192024-08-27T18:59:27.116ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3202024-08-27T18:59:27.116ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3212024-08-27T18:59:27.116ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3222024-08-27T18:59:27.126ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:360
3232024-08-27T18:59:27.126ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool)
3242024-08-27T18:59:27.220ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }
3252024-08-27T18:59:27.229ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:351
3262024-08-27T18:59:27.229ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:353
3272024-08-27T18:59:27.229ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:357
3282024-08-27T18:59:27.229ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:359
3292024-08-27T18:59:27.229ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-08-27T18:59:27.229ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312024-08-27T18:59:27.229ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3322024-08-27T18:59:27.263ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3332024-08-27T18:59:27.272ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c75d3f85-2b4d-4485-aa90-58be246da1bc/crypt/zone file = sled-storage/src/dataset.rs:414
3342024-08-27T18:59:27.398ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c75d3f85-2b4d-4485-aa90-58be246da1bc file = sled-storage/src/dataset.rs:499
3352024-08-27T18:59:27.407ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3362024-08-27T18:59:27.407ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3372024-08-27T18:59:27.407ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3382024-08-27T18:59:27.407ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3392024-08-27T18:59:27.407ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3402024-08-27T18:59:27.416ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:360
3412024-08-27T18:59:27.416ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool)
3422024-08-27T18:59:27.512ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }
3432024-08-27T18:59:27.520ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:351
3442024-08-27T18:59:27.520ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:353
3452024-08-27T18:59:27.520ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:357
3462024-08-27T18:59:27.520ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:359
3472024-08-27T18:59:27.520ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-08-27T18:59:27.520ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492024-08-27T18:59:27.520ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3502024-08-27T18:59:27.557ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3512024-08-27T18:59:27.565ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ece87f46-247e-409b-ad26-6e8e96c7e756/crypt/zone file = sled-storage/src/dataset.rs:414
3522024-08-27T18:59:27.687ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ece87f46-247e-409b-ad26-6e8e96c7e756 file = sled-storage/src/dataset.rs:499
3532024-08-27T18:59:27.695ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3542024-08-27T18:59:27.695ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3552024-08-27T18:59:27.695ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3562024-08-27T18:59:27.695ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3572024-08-27T18:59:27.695ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3582024-08-27T18:59:27.704ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:360
3592024-08-27T18:59:27.704ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool)
3602024-08-27T18:59:27.796ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool), kind: External }
3612024-08-27T18:59:27.804ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:351
3622024-08-27T18:59:27.804ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:353
3632024-08-27T18:59:27.804ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:357
3642024-08-27T18:59:27.804ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:359
3652024-08-27T18:59:27.804ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-08-27T18:59:27.804ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672024-08-27T18:59:27.804ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3682024-08-27T18:59:27.840ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-08-27T18:59:27.848ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6a874446-59c2-4b92-800d-d0a1bfbe68dd/crypt/zone file = sled-storage/src/dataset.rs:414
3702024-08-27T18:59:27.972ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6a874446-59c2-4b92-800d-d0a1bfbe68dd file = sled-storage/src/dataset.rs:499
3712024-08-27T18:59:27.980ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3722024-08-27T18:59:27.980ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3732024-08-27T18:59:27.980ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3742024-08-27T18:59:27.980ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3752024-08-27T18:59:27.980ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762024-08-27T18:59:27.991ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:360
3772024-08-27T18:59:27.991ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = 030f20e2-2758-4a47-92fd-4adaf0953899 (zpool)
3782024-08-27T18:59:28.093ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: 030f20e2-2758-4a47-92fd-4adaf0953899 (zpool), kind: External }
3792024-08-27T18:59:28.101ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:351
3802024-08-27T18:59:28.101ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:353
3812024-08-27T18:59:28.101ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:357
3822024-08-27T18:59:28.101ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:359
3832024-08-27T18:59:28.101ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-08-27T18:59:28.102ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-08-27T18:59:28.102ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
3862024-08-27T18:59:28.114ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e38b401b-2d22-4589-ac73-fc644b0a15b2): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
3872024-08-27T18:59:28.137ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882024-08-27T18:59:28.145ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_030f20e2-2758-4a47-92fd-4adaf0953899/crypt/zone file = sled-storage/src/dataset.rs:414
3892024-08-27T18:59:28.273ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_030f20e2-2758-4a47-92fd-4adaf0953899 file = sled-storage/src/dataset.rs:499
3902024-08-27T18:59:28.281ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3912024-08-27T18:59:28.281ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3922024-08-27T18:59:28.281ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3932024-08-27T18:59:28.281ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3942024-08-27T18:59:28.281ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3952024-08-27T18:59:28.291ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:360
3962024-08-27T18:59:28.291ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = a954bc02-0277-475f-b5f2-befa522b2371 (zpool)
3972024-08-27T18:59:28.386ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: a954bc02-0277-475f-b5f2-befa522b2371 (zpool), kind: External }
3982024-08-27T18:59:28.393ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:351
3992024-08-27T18:59:28.393ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:353
4002024-08-27T18:59:28.393ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:357
4012024-08-27T18:59:28.393ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:359
4022024-08-27T18:59:28.393ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-08-27T18:59:28.394ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-08-27T18:59:28.394ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
4052024-08-27T18:59:28.426ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4062024-08-27T18:59:28.433ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_a954bc02-0277-475f-b5f2-befa522b2371/crypt/zone file = sled-storage/src/dataset.rs:414
4072024-08-27T18:59:28.548ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_a954bc02-0277-475f-b5f2-befa522b2371 file = sled-storage/src/dataset.rs:499
4082024-08-27T18:59:28.556ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4092024-08-27T18:59:28.556ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4102024-08-27T18:59:28.556ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4112024-08-27T18:59:28.556ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4122024-08-27T18:59:28.556ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4132024-08-27T18:59:28.566ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:360
4142024-08-27T18:59:28.566ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:366 id = c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool)
4152024-08-27T18:59:28.660ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:307 zpool = ZpoolName { id: c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool), kind: External }
4162024-08-27T18:59:28.668ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:351
4172024-08-27T18:59:28.668ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:353
4182024-08-27T18:59:28.668ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:357
4192024-08-27T18:59:28.668ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:359
4202024-08-27T18:59:28.668ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-08-27T18:59:28.668ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-08-27T18:59:28.668ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:371
4232024-08-27T18:59:28.705ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4242024-08-27T18:59:28.713ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c21168f7-9204-4a38-9c41-94555fc3bf91/crypt/zone file = sled-storage/src/dataset.rs:414
4252024-08-27T18:59:28.838ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c21168f7-9204-4a38-9c41-94555fc3bf91 file = sled-storage/src/dataset.rs:499
4262024-08-27T18:59:28.846ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4272024-08-27T18:59:28.846ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4282024-08-27T18:59:28.846ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4292024-08-27T18:59:28.846ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 861e54cf-f95e-47d9-b389-b519c9faa394 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b66efe43-f3db-4ebe-bf21-a63dbb6594b9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 030f20e2-2758-4a47-92fd-4adaf0953899 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: a954bc02-0277-475f-b5f2-befa522b2371 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4302024-08-27T18:59:28.846ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4312024-08-27T18:59:28.846ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4322024-08-27T18:59:28.846ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332024-08-27T18:59:28.846ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:834 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
4342024-08-27T18:59:28.846ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4352024-08-27T18:59:28.846ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:860 generation = Generation(1) sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
4362024-08-27T18:59:28.846ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:865 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
4372024-08-27T18:59:28.846ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:870 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
4382024-08-27T18:59:28.847ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:121 gen = Generation(1) sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
4392024-08-27T18:59:28.847ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:876 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
4402024-08-27T18:59:28.847ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:803 gen = Generation(1)
4412024-08-27T18:59:28.847ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:881 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
4422024-08-27T18:59:28.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3307478 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:38475 req_id = 8c4d4b5f-b631-42f8-be97-5dd28668944a response_code = 200 uri = /omicron-physical-disks
4432024-08-27T18:59:28.878ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
4442024-08-27T18:59:28.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51743
4452024-08-27T18:59:28.879ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
4462024-08-27T18:59:28.879ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4472024-08-27T18:59:28.929ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
4482024-08-27T18:59:28.929ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: InternalDns }, responder: ... }
4492024-08-27T18:59:28.982ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
4502024-08-27T18:59:28.982ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: InternalDns }, responder: ... }
4512024-08-27T18:59:29.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4522024-08-27T18:59:29.034ZINFOSledAgent (ServiceManager): No ledger in /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/omicron-zones.json file = common/src/ledger.rs:188
4532024-08-27T18:59:29.034ZINFOSledAgent (ServiceManager): No ledger in /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/omicron-zones.json file = common/src/ledger.rs:188
4542024-08-27T18:59:29.034ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4552024-08-27T18:59:29.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4562024-08-27T18:59:29.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4572024-08-27T18:59:29.079ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4582024-08-27T18:59:29.119ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e38b401b-2d22-4589-ac73-fc644b0a15b2): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
4592024-08-27T18:59:29.133ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f file = illumos-utils/src/zone.rs:316
4602024-08-27T18:59:29.137ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426 file = illumos-utils/src/zone.rs:316
4612024-08-27T18:59:29.141ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7 file = illumos-utils/src/zone.rs:316
4622024-08-27T18:59:29.155ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f file = illumos-utils/src/zone.rs:354
4632024-08-27T18:59:29.160ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426 file = illumos-utils/src/zone.rs:354
4642024-08-27T18:59:29.164ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7 file = illumos-utils/src/zone.rs:354
4652024-08-27T18:59:30.121ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e38b401b-2d22-4589-ac73-fc644b0a15b2): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:230 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
4662024-08-27T18:59:30.625ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4672024-08-27T18:59:30.625ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4682024-08-27T18:59:31.101ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4692024-08-27T18:59:31.103ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
4702024-08-27T18:59:31.582ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4712024-08-27T18:59:31.582ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4722024-08-27T18:59:31.582ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4732024-08-27T18:59:31.582ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
4742024-08-27T18:59:31.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426") failed: Property not found. retry in 34.062834ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
4752024-08-27T18:59:31.596ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
4762024-08-27T18:59:31.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426") failed: Property not found. retry in 113.44366ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
4772024-08-27T18:59:31.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 36.210151ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
4782024-08-27T18:59:31.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7") failed: Property not found. retry in 62.064516ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
4792024-08-27T18:59:31.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 113.869492ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
4802024-08-27T18:59:31.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426") failed: Property not found. retry in 181.264502ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
4812024-08-27T18:59:31.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7") failed: Property not found. retry in 57.196471ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
4822024-08-27T18:59:31.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 275.079156ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
4832024-08-27T18:59:31.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7") failed: Property not found. retry in 271.034733ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
4842024-08-27T18:59:32.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426") failed: Property not found. retry in 497.539554ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
4852024-08-27T18:59:32.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 531.55756ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
4862024-08-27T18:59:32.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7") failed: Property not found. retry in 510.486153ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
4872024-08-27T18:59:32.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426") failed: Property not found. retry in 878.590662ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
4882024-08-27T18:59:32.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 428.177074ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
4892024-08-27T18:59:32.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7") failed: Property not found. retry in 1.090772647s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
4902024-08-27T18:59:33.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 721.541479ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
4912024-08-27T18:59:33.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426") failed: Property not found. retry in 1.166193354s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
4922024-08-27T18:59:33.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7") failed: Property not found. retry in 919.889472ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
4932024-08-27T18:59:33.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 974.478592ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
4942024-08-27T18:59:34.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426") failed: Property not found. retry in 532.686979ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
4952024-08-27T18:59:34.719ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4206
4962024-08-27T18:59:34.719ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4216 gateway = fd00:1122:3344:101::1
4972024-08-27T18:59:34.725ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4295
4982024-08-27T18:59:34.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7") failed: Property not found. retry in 1.376255984s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
4992024-08-27T18:59:34.850ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4343
5002024-08-27T18:59:34.850ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4370
5012024-08-27T18:59:34.888ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4383
5022024-08-27T18:59:34.888ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4247
5032024-08-27T18:59:34.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 634.272372ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
5042024-08-27T18:59:34.941ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4289
5052024-08-27T18:59:34.941ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4350 rack_subnet = fd00:1122:3344::
5062024-08-27T18:59:34.960ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4361
5072024-08-27T18:59:34.960ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4403
5082024-08-27T18:59:35.044ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4435
5092024-08-27T18:59:35.044ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4441
5102024-08-27T18:59:35.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426") failed: Property not found. retry in 614.088475ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
5112024-08-27T18:59:35.156ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4482
5122024-08-27T18:59:35.156ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:366
5132024-08-27T18:59:35.189ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e38b401b-2d22-4589-ac73-fc644b0a15b2): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:571 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
5142024-08-27T18:59:35.189ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 25.851969ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5152024-08-27T18:59:35.216ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 112.401336ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5162024-08-27T18:59:35.329ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 168.241457ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5172024-08-27T18:59:35.499ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 439.129125ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/bootstrap/early_networking.rs:385
5182024-08-27T18:59:35.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 928.571175ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
5192024-08-27T18:59:35.617ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::2]:55577
5202024-08-27T18:59:35.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::2]:55577 req_id = f960c380-3d81-4ee4-8f33-58ec05d66dc1 response_code = 200 uri = /sled-identifiers
5212024-08-27T18:59:35.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426") failed: Property not found. retry in 1.056469824s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
5222024-08-27T18:59:35.940ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:414
5232024-08-27T18:59:35.972ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:676
5242024-08-27T18:59:35.972ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:714
5252024-08-27T18:59:35.973ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:717 uptime = 0
5262024-08-27T18:59:35.973ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:436
5272024-08-27T18:59:36.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
5282024-08-27T18:59:36.064ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:406
5292024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5302024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5312024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5322024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5332024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5342024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5352024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5362024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5372024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5382024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5392024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5402024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5412024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5422024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5432024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5442024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5452024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5462024-08-27T18:59:36.064ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5472024-08-27T18:59:36.065ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5482024-08-27T18:59:36.065ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5492024-08-27T18:59:36.065ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5502024-08-27T18:59:36.065ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5512024-08-27T18:59:36.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7") failed: Property not found. retry in 571.525151ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
5522024-08-27T18:59:36.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f") failed: Property not found. retry in 795.818011ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
5532024-08-27T18:59:37.191ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e38b401b-2d22-4589-ac73-fc644b0a15b2): error trying to connect: dns error: no record found for Query { name: Name("_nexus._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN } file = sled-agent/src/nexus.rs:571 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
5542024-08-27T18:59:37.290ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_internal_dns_12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f
5552024-08-27T18:59:37.290ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_internal_dns_b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426
5562024-08-27T18:59:37.290ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_internal_dns_28126e25-07e2-4032-8ea4-b0e36ed725b7
5572024-08-27T18:59:37.290ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5582024-08-27T18:59:37.290ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5592024-08-27T18:59:37.290ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8411901 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:51743 req_id = af98139f-9788-484e-af51-57588eec0585 response_code = 204 uri = /omicron-zones
5602024-08-27T18:59:37.292ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5612024-08-27T18:59:37.338ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5622024-08-27T18:59:37.385ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:555
5632024-08-27T18:59:37.431ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:591
5642024-08-27T18:59:37.431ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5652024-08-27T18:59:37.464ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5662024-08-27T18:59:37.465ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5672024-08-27T18:59:37.465ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5682024-08-27T18:59:37.494ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: c58ff409-61a2-4334-bbe9-10d0b34582fa, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: dd50ee59-ffa2-4273-a85b-785bcbffe16b, kind: Service { id: c58ff409-61a2-4334-bbe9-10d0b34582fa }, name: Name("ntp-c58ff409-61a2-4334-bbe9-10d0b34582fa"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 92])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
5692024-08-27T18:59:37.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37222
5702024-08-27T18:59:37.495ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
5712024-08-27T18:59:37.495ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5722024-08-27T18:59:37.517ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
5732024-08-27T18:59:37.517ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: InternalDns }, responder: ... }
5742024-08-27T18:59:37.536ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
5752024-08-27T18:59:37.536ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: InternalDns }, responder: ... }
5762024-08-27T18:59:37.552ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
5772024-08-27T18:59:37.552ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/omicron-zones.json file = common/src/ledger.rs:177
5782024-08-27T18:59:37.552ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/omicron-zones.json file = common/src/ledger.rs:177
5792024-08-27T18:59:37.552ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
5802024-08-27T18:59:37.562ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
5812024-08-27T18:59:37.595ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
5822024-08-27T18:59:37.597ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
5832024-08-27T18:59:37.597ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
5842024-08-27T18:59:37.629ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 136, 92]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
5852024-08-27T18:59:37.629ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = boundary_ntp
5862024-08-27T18:59:37.629ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
5872024-08-27T18:59:37.629ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
5882024-08-27T18:59:37.629ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
5892024-08-27T18:59:37.630ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
5902024-08-27T18:59:37.651ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa file = illumos-utils/src/zone.rs:316
5912024-08-27T18:59:37.670ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa file = illumos-utils/src/zone.rs:354
5922024-08-27T18:59:38.310ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5932024-08-27T18:59:38.310ZINFOSledAgent (ServiceManager): Booting oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
5942024-08-27T18:59:38.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa") failed: Property not found. retry in 68.828523ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
5952024-08-27T18:59:38.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa") failed: Property not found. retry in 110.27411ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
5962024-08-27T18:59:38.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa") failed: Property not found. retry in 133.50327ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
5972024-08-27T18:59:38.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa") failed: Property not found. retry in 491.427793ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
5982024-08-27T18:59:39.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa") failed: Property not found. retry in 1.151883779s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
5992024-08-27T18:59:40.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa") failed: Property not found. retry in 579.848565ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
6002024-08-27T18:59:41.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa") failed: Property not found. retry in 885.669443ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
6012024-08-27T18:59:41.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa") failed: Property not found. retry in 591.924839ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
6022024-08-27T18:59:42.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa") failed: Property not found. retry in 1.197406385s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
6032024-08-27T18:59:43.778ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa
6042024-08-27T18:59:43.778ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6052024-08-27T18:59:43.779ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6062024-08-27T18:59:43.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6284587 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37222 req_id = 0d43089f-9b62-4c64-9f43-07027ec33766 response_code = 204 uri = /omicron-zones
6072024-08-27T18:59:43.782ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:632
6082024-08-27T18:59:43.812ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6092024-08-27T18:59:43.812ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47872
6102024-08-27T18:59:43.822ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3847
6112024-08-27T18:59:43.822ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 9507 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47872 req_id = 475b8a49-faa3-4c60-ae33-b80911093b69 response_code = 500 uri = /timesync
6122024-08-27T18:59:43.825ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6132024-08-27T18:59:44.002ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6142024-08-27T18:59:44.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50359
6152024-08-27T18:59:48.010ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3847
6162024-08-27T18:59:48.010ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 4008472 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50359 req_id = 06b73413-513a-4d29-b3f4-76775d5fe86e response_code = 500 uri = /timesync
6172024-08-27T18:59:48.014ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6182024-08-27T18:59:48.115ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6192024-08-27T18:59:48.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54357
6202024-08-27T18:59:48.124ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c58ff409-61a2-4334-bbe9-10d0b34582fa': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3847
6212024-08-27T18:59:48.124ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:902 latency_us = 8808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54357 req_id = 43dbd0c1-de62-4821-8e28-f789772e3bfb response_code = 500 uri = /timesync
6222024-08-27T18:59:48.128ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6232024-08-27T18:59:48.349ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6242024-08-27T18:59:48.349ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61228
6252024-08-27T18:59:48.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8084 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61228 req_id = 685a3420-9b82-4ea0-88ac-b89105877050 response_code = 200 uri = /timesync
6262024-08-27T18:59:48.359ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6272024-08-27T18:59:48.359ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6282024-08-27T18:59:48.552ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6292024-08-27T18:59:48.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43141
6302024-08-27T18:59:48.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43141 req_id = 5fbcfdcd-845d-4337-bdb0-78e85613e661 response_code = 200 uri = /timesync
6312024-08-27T18:59:48.562ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6322024-08-27T18:59:48.562ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6332024-08-27T18:59:48.816ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6342024-08-27T18:59:48.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43125
6352024-08-27T18:59:48.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9065 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43125 req_id = a1f7014d-edac-44f2-ab5c-f75e01723631 response_code = 200 uri = /timesync
6362024-08-27T18:59:48.827ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6372024-08-27T18:59:48.827ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6382024-08-27T18:59:49.005ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6392024-08-27T18:59:49.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35282
6402024-08-27T18:59:49.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8096 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35282 req_id = de4594de-5c0e-40ce-a268-85776d759328 response_code = 200 uri = /timesync
6412024-08-27T18:59:49.016ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6422024-08-27T18:59:49.016ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6432024-08-27T18:59:49.222ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6442024-08-27T18:59:49.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60799
6452024-08-27T18:59:49.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60799 req_id = f925b240-ece9-4ff8-971a-bab139726fe0 response_code = 200 uri = /timesync
6462024-08-27T18:59:49.232ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6472024-08-27T18:59:49.232ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6482024-08-27T18:59:49.524ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6492024-08-27T18:59:49.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56590
6502024-08-27T18:59:49.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56590 req_id = 1065a7ab-55ca-4df1-b9f8-3581f9a7362f response_code = 200 uri = /timesync
6512024-08-27T18:59:49.535ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6522024-08-27T18:59:49.535ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6532024-08-27T18:59:50.137ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6542024-08-27T18:59:50.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57933
6552024-08-27T18:59:50.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8563 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57933 req_id = a8547c96-b4f8-4cb8-bd86-39a65c9178c9 response_code = 200 uri = /timesync
6562024-08-27T18:59:50.148ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6572024-08-27T18:59:50.148ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6582024-08-27T18:59:50.569ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6592024-08-27T18:59:50.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63585
6602024-08-27T18:59:50.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63585 req_id = 57763a2d-e6aa-409c-babb-8e1ee5964ede response_code = 200 uri = /timesync
6612024-08-27T18:59:50.579ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:640
6622024-08-27T18:59:50.579ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6632024-08-27T18:59:51.910ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6642024-08-27T18:59:51.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39672
6652024-08-27T18:59:51.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8438 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39672 req_id = d0086c81-eeaa-41e5-bb0a-2861828f73de response_code = 200 uri = /timesync
6662024-08-27T18:59:51.921ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785191.4023333, correction: -0.221534252 } file = sled-agent/src/rack_setup/service.rs:640
6672024-08-27T18:59:51.921ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6682024-08-27T18:59:52.875ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6692024-08-27T18:59:52.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56998
6702024-08-27T18:59:52.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9027 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56998 req_id = 0460e176-616b-4767-8952-38e9ac8f1df3 response_code = 200 uri = /timesync
6712024-08-27T18:59:52.886ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724785189.7974775, correction: -0.218757764 } file = sled-agent/src/rack_setup/service.rs:640
6722024-08-27T18:59:52.886ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6732024-08-27T18:59:53.470ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6742024-08-27T18:59:53.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45081
6752024-08-27T18:59:53.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8560 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45081 req_id = a16b268d-8777-4957-854b-e4f6604a4cee response_code = 200 uri = /timesync
6762024-08-27T18:59:53.481ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724785189.7974775, correction: -0.217142403 } file = sled-agent/src/rack_setup/service.rs:640
6772024-08-27T18:59:53.481ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6782024-08-27T18:59:54.612ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6792024-08-27T18:59:54.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33966
6802024-08-27T18:59:54.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33966 req_id = 27410494-0398-47ea-842f-878fa2b64767 response_code = 200 uri = /timesync
6812024-08-27T18:59:54.623ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724785189.7974775, correction: -0.209545568 } file = sled-agent/src/rack_setup/service.rs:640
6822024-08-27T18:59:54.623ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6832024-08-27T18:59:55.546ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6842024-08-27T18:59:55.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43410
6852024-08-27T18:59:55.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8775 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43410 req_id = dd848b53-7420-48f8-8648-20408091e4d9 response_code = 200 uri = /timesync
6862024-08-27T18:59:55.557ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1724785189.7974775, correction: -0.205104575 } file = sled-agent/src/rack_setup/service.rs:640
6872024-08-27T18:59:55.557ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6882024-08-27T18:59:56.509ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6892024-08-27T18:59:56.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60221
6902024-08-27T18:59:56.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7652 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60221 req_id = e21ab114-9490-4228-8167-ba7830ad23d5 response_code = 200 uri = /timesync
6912024-08-27T18:59:56.521ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785194.8360417, correction: -0.201430574 } file = sled-agent/src/rack_setup/service.rs:640
6922024-08-27T18:59:56.521ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6932024-08-27T18:59:56.629ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 372.156567ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
6942024-08-27T18:59:58.653ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
6952024-08-27T18:59:58.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33719
6962024-08-27T18:59:58.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 10192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33719 req_id = b6ff4876-c1a9-4a00-9a29-fa403b227fb5 response_code = 200 uri = /timesync
6972024-08-27T18:59:58.667ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785197.0104222, correction: -0.194702491 } file = sled-agent/src/rack_setup/service.rs:640
6982024-08-27T18:59:58.667ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
6992024-08-27T19:00:01.962ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7002024-08-27T19:00:01.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61881
7012024-08-27T19:00:01.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9639 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61881 req_id = e0796ad3-be44-4adf-b663-212425299ee0 response_code = 200 uri = /timesync
7022024-08-27T19:00:01.974ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785201.3191586, correction: -0.18598409 } file = sled-agent/src/rack_setup/service.rs:640
7032024-08-27T19:00:01.974ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7042024-08-27T19:00:03.797ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7052024-08-27T19:00:03.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37596
7062024-08-27T19:00:03.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8912 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37596 req_id = 5917441c-f13b-4d37-b816-b9f9debdcd96 response_code = 200 uri = /timesync
7072024-08-27T19:00:03.811ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785201.949174, correction: -0.180930197 } file = sled-agent/src/rack_setup/service.rs:640
7082024-08-27T19:00:03.811ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7092024-08-27T19:00:05.546ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45124
7102024-08-27T19:00:05.546ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45124 req_id = 3a779202-6040-41f5-8de4-addf82a99f76 response_code = 200 uri = /baseboard
7112024-08-27T19:00:07.347ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7122024-08-27T19:00:07.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33351
7132024-08-27T19:00:07.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33351 req_id = 9665e274-893c-41e4-8c85-1bcda266d301 response_code = 200 uri = /timesync
7142024-08-27T19:00:07.359ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785205.8790507, correction: -0.172592923 } file = sled-agent/src/rack_setup/service.rs:640
7152024-08-27T19:00:07.359ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7162024-08-27T19:00:09.700ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7172024-08-27T19:00:09.700ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54430
7182024-08-27T19:00:09.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8883 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54430 req_id = 9a72053d-18a1-4272-a3df-3e4692d27548 response_code = 200 uri = /timesync
7192024-08-27T19:00:09.713ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785207.950796, correction: -0.165190324 } file = sled-agent/src/rack_setup/service.rs:640
7202024-08-27T19:00:09.713ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7212024-08-27T19:00:11.993ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 337.21364ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
7222024-08-27T19:00:12.102ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7232024-08-27T19:00:12.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47112
7242024-08-27T19:00:12.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8556 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47112 req_id = 81e9fc23-8606-4091-8b0e-bf353430b1f6 response_code = 200 uri = /timesync
7252024-08-27T19:00:12.113ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785210.8076105, correction: -0.158249944 } file = sled-agent/src/rack_setup/service.rs:640
7262024-08-27T19:00:12.113ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7272024-08-27T19:00:17.487ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7282024-08-27T19:00:17.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52903
7292024-08-27T19:00:17.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8975 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52903 req_id = 6f740dca-2813-4296-bafb-20d9fa6ce59c response_code = 200 uri = /timesync
7302024-08-27T19:00:17.498ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785215.0474887, correction: -0.143836766 } file = sled-agent/src/rack_setup/service.rs:640
7312024-08-27T19:00:17.498ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7322024-08-27T19:00:22.722ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7332024-08-27T19:00:22.722ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56576
7342024-08-27T19:00:22.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8729 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56576 req_id = 215d7a14-c204-4869-a8ba-c5fdbd7fc20f response_code = 200 uri = /timesync
7352024-08-27T19:00:22.734ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785221.1329246, correction: -0.129631564 } file = sled-agent/src/rack_setup/service.rs:640
7362024-08-27T19:00:22.734ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7372024-08-27T19:00:27.326ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 761.386626ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
7382024-08-27T19:00:32.447ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7392024-08-27T19:00:32.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54084
7402024-08-27T19:00:32.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8869 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54084 req_id = c339bfa2-a71c-4907-840a-e20c052ad196 response_code = 200 uri = /timesync
7412024-08-27T19:00:32.459ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785229.4016464, correction: -0.10345155 } file = sled-agent/src/rack_setup/service.rs:640
7422024-08-27T19:00:32.459ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7432024-08-27T19:00:35.505ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63374
7442024-08-27T19:00:35.505ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63374 req_id = 79d2ef2c-e915-4445-96cd-f776cd424c6c response_code = 200 uri = /baseboard
7452024-08-27T19:00:43.080ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.163148483s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
7462024-08-27T19:00:45.914ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7472024-08-27T19:00:45.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65443
7482024-08-27T19:00:45.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 9137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65443 req_id = bdd288ea-7ee0-43e9-8077-5ef7d4dfbdf4 response_code = 200 uri = /timesync
7492024-08-27T19:00:45.926ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785243.3880017, correction: -0.065420143 } file = sled-agent/src/rack_setup/service.rs:640
7502024-08-27T19:00:45.926ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:662
7512024-08-27T19:00:52.919ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:612
7522024-08-27T19:00:52.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43638
7532024-08-27T19:00:52.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 21620 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43638 req_id = f3068b8d-0bbf-4d8f-98b3-68821277fee1 response_code = 200 uri = /timesync
7542024-08-27T19:00:52.945ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 395126908, ip_addr: 23.141.40.124, stratum: 3, ref_time: 1724785251.7093554, correction: -0.043686554 } file = sled-agent/src/rack_setup/service.rs:640
7552024-08-27T19:00:52.945ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1266
7562024-08-27T19:00:52.976ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: c58ff409-61a2-4334-bbe9-10d0b34582fa, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: dd50ee59-ffa2-4273-a85b-785bcbffe16b, kind: Service { id: c58ff409-61a2-4334-bbe9-10d0b34582fa }, name: Name("ntp-c58ff409-61a2-4334-bbe9-10d0b34582fa"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 92])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: dae07c98-fe1f-4226-b25a-884690e85195, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 68c29e6d-6134-4678-be81-fd53901e9105, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External } } } }, OmicronZoneConfig { id: afb193bd-2840-4e76-a967-0dee9f03c40c, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External } } } }, OmicronZoneConfig { id: a0cd76dd-890f-40d6-b9c9-466b1152d492, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External } } } }, OmicronZoneConfig { id: 19bd4462-2353-4408-860c-54bff4d4af2c, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
7572024-08-27T19:00:52.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52920
7582024-08-27T19:00:52.976ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
7592024-08-27T19:00:52.976ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7602024-08-27T19:00:52.996ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
7612024-08-27T19:00:52.996ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7622024-08-27T19:00:53.015ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
7632024-08-27T19:00:53.015ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: InternalDns }, responder: ... }
7642024-08-27T19:00:53.035ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: dae07c98-fe1f-4226-b25a-884690e85195, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7652024-08-27T19:00:53.035ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: dae07c98-fe1f-4226-b25a-884690e85195, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7662024-08-27T19:00:53.091ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68c29e6d-6134-4678-be81-fd53901e9105, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7672024-08-27T19:00:53.091ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 68c29e6d-6134-4678-be81-fd53901e9105, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7682024-08-27T19:00:53.142ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: afb193bd-2840-4e76-a967-0dee9f03c40c, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7692024-08-27T19:00:53.142ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: afb193bd-2840-4e76-a967-0dee9f03c40c, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7702024-08-27T19:00:53.193ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a0cd76dd-890f-40d6-b9c9-466b1152d492, dataset_name: DatasetName { pool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7712024-08-27T19:00:53.193ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: a0cd76dd-890f-40d6-b9c9-466b1152d492, dataset_name: DatasetName { pool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7722024-08-27T19:00:53.245ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19bd4462-2353-4408-860c-54bff4d4af2c, dataset_name: DatasetName { pool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7732024-08-27T19:00:53.245ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 19bd4462-2353-4408-860c-54bff4d4af2c, dataset_name: DatasetName { pool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7742024-08-27T19:00:53.300ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7752024-08-27T19:00:53.300ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/omicron-zones.json file = common/src/ledger.rs:177
7762024-08-27T19:00:53.300ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/omicron-zones.json file = common/src/ledger.rs:177
7772024-08-27T19:00:53.300ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7782024-08-27T19:00:53.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7792024-08-27T19:00:53.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7802024-08-27T19:00:53.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7812024-08-27T19:00:53.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7822024-08-27T19:00:53.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7832024-08-27T19:00:53.474ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105 file = illumos-utils/src/zone.rs:316
7842024-08-27T19:00:53.479ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c file = illumos-utils/src/zone.rs:316
7852024-08-27T19:00:53.483ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c file = illumos-utils/src/zone.rs:316
7862024-08-27T19:00:53.487ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492 file = illumos-utils/src/zone.rs:316
7872024-08-27T19:00:53.492ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195 file = illumos-utils/src/zone.rs:316
7882024-08-27T19:00:53.497ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105 file = illumos-utils/src/zone.rs:354
7892024-08-27T19:00:53.501ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c file = illumos-utils/src/zone.rs:354
7902024-08-27T19:00:53.506ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c file = illumos-utils/src/zone.rs:354
7912024-08-27T19:00:53.511ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492 file = illumos-utils/src/zone.rs:354
7922024-08-27T19:00:53.515ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195 file = illumos-utils/src/zone.rs:354
7932024-08-27T19:00:56.444ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='68c29e6d-6134-4678-be81-fd53901e9105'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7942024-08-27T19:00:56.445ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
7952024-08-27T19:00:56.451ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='afb193bd-2840-4e76-a967-0dee9f03c40c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7962024-08-27T19:00:56.451ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
7972024-08-27T19:00:56.492ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='a0cd76dd-890f-40d6-b9c9-466b1152d492'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7982024-08-27T19:00:56.492ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
7992024-08-27T19:00:56.503ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='19bd4462-2353-4408-860c-54bff4d4af2c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8002024-08-27T19:00:56.503ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8012024-08-27T19:00:56.561ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='dae07c98-fe1f-4226-b25a-884690e85195'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8022024-08-27T19:00:56.562ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8032024-08-27T19:00:56.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 74.946441ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8042024-08-27T19:00:56.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 72.552255ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8052024-08-27T19:00:56.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 73.260328ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8062024-08-27T19:00:56.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 28.002448ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8072024-08-27T19:00:57.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 80.794867ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8082024-08-27T19:00:57.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 73.838703ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8092024-08-27T19:00:57.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 83.63117ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8102024-08-27T19:00:57.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 267.99617ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8112024-08-27T19:00:58.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 79.250749ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8122024-08-27T19:00:59.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 180.731663ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8132024-08-27T19:00:59.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 50.219401ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8142024-08-27T19:00:59.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 268.542303ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8152024-08-27T19:00:59.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 366.561647ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8162024-08-27T19:00:59.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 180.242565ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8172024-08-27T19:00:59.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 50.602924ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8182024-08-27T19:00:59.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 177.647348ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8192024-08-27T19:00:59.245ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.340763002s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
8202024-08-27T19:00:59.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 425.134677ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8212024-08-27T19:00:59.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 542.435148ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8222024-08-27T19:00:59.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 420.62164ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8232024-08-27T19:00:59.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 582.157484ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8242024-08-27T19:00:59.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 904.271732ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8252024-08-27T19:00:59.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 713.246168ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8262024-08-27T19:00:59.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 545.574704ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8272024-08-27T19:00:59.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 742.945542ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8282024-08-27T19:01:00.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 564.577824ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8292024-08-27T19:01:00.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 1.311987598s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8302024-08-27T19:01:00.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 1.498994801s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8312024-08-27T19:01:00.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 1.212167051s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8322024-08-27T19:01:00.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 585.970226ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8332024-08-27T19:01:00.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 1.238793141s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8342024-08-27T19:01:01.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 1.185310376s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8352024-08-27T19:01:01.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 762.297782ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8362024-08-27T19:01:01.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 879.484692ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8372024-08-27T19:01:01.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 1.201842174s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8382024-08-27T19:01:01.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 1.336238635s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8392024-08-27T19:01:02.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 936.93735ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8402024-08-27T19:01:02.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 651.532351ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8412024-08-27T19:01:02.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 1.038369289s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8422024-08-27T19:01:03.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 1.425741642s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8432024-08-27T19:01:03.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 1.104694046s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8442024-08-27T19:01:03.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 945.819809ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8452024-08-27T19:01:03.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 1.355605437s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8462024-08-27T19:01:03.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 578.46004ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8472024-08-27T19:01:04.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 723.250113ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8482024-08-27T19:01:04.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 857.006052ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8492024-08-27T19:01:04.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 1.409913141s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8502024-08-27T19:01:04.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 575.682005ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8512024-08-27T19:01:04.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 1.026414708s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8522024-08-27T19:01:04.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 1.167990714s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8532024-08-27T19:01:05.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 970.002106ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8542024-08-27T19:01:05.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 1.218450225s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8552024-08-27T19:01:05.457ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52771
8562024-08-27T19:01:05.457ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 86 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52771 req_id = 2524326a-0afd-4ee2-b84f-79b872f56d09 response_code = 200 uri = /baseboard
8572024-08-27T19:01:05.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 901.980583ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8582024-08-27T19:01:05.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 1.232245255s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8592024-08-27T19:01:06.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 803.53474ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8602024-08-27T19:01:06.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 1.375438787s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8612024-08-27T19:01:06.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 1.012346646s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8622024-08-27T19:01:06.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 778.123311ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8632024-08-27T19:01:06.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 1.494737112s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8642024-08-27T19:01:06.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 573.062881ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8652024-08-27T19:01:07.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105") failed: Property not found. retry in 962.383602ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8662024-08-27T19:01:07.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 800.529482ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8672024-08-27T19:01:07.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 1.256864728s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8682024-08-27T19:01:07.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 1.248529348s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8692024-08-27T19:01:08.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c") failed: Property not found. retry in 1.400277094s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8702024-08-27T19:01:08.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c") failed: Property not found. retry in 663.386024ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8712024-08-27T19:01:08.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492") failed: Property not found. retry in 889.78802ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8722024-08-27T19:01:08.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195") failed: Property not found. retry in 1.237437682s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8732024-08-27T19:01:10.044ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_a0cd76dd-890f-40d6-b9c9-466b1152d492
8742024-08-27T19:01:10.044ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_dae07c98-fe1f-4226-b25a-884690e85195
8752024-08-27T19:01:10.044ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_68c29e6d-6134-4678-be81-fd53901e9105
8762024-08-27T19:01:10.044ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_19bd4462-2353-4408-860c-54bff4d4af2c
8772024-08-27T19:01:10.044ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_cockroachdb_afb193bd-2840-4e76-a967-0dee9f03c40c
8782024-08-27T19:01:10.044ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8792024-08-27T19:01:10.044ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8802024-08-27T19:01:10.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 17115212 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52920 req_id = 90c42e39-d3fb-46aa-a51f-bfd2d4a3dd49 response_code = 204 uri = /omicron-zones
8812024-08-27T19:01:10.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37479
8822024-08-27T19:01:10.108ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3681
8832024-08-27T19:01:31.060ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3699
8842024-08-27T19:01:37.587ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3722
8852024-08-27T19:01:37.588ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 27508641 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37479 req_id = 898b5ffc-6731-4faa-bf21-b7e44b47026e response_code = 204 uri = /cockroachdb
8862024-08-27T19:01:37.591ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47478
8872024-08-27T19:01:37.592ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 885 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47478 req_id = a952b847-f37f-4395-96aa-994213021260 response_code = 200 uri = /baseboard
8882024-08-27T19:01:37.610ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.045024304s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
8892024-08-27T19:01:37.639ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, underlay_address: fd00:1122:3344:1::1, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, underlay_address: fd00:1122:3344:2::1, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, underlay_address: fd00:1122:3344:3::1, filesystem_pool: Some(ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: c58ff409-61a2-4334-bbe9-10d0b34582fa, underlay_address: fd00:1122:3344:101::1b, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: dd50ee59-ffa2-4273-a85b-785bcbffe16b, kind: Service { id: c58ff409-61a2-4334-bbe9-10d0b34582fa }, name: Name("ntp-c58ff409-61a2-4334-bbe9-10d0b34582fa"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 136, 92])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: dae07c98-fe1f-4226-b25a-884690e85195, underlay_address: fd00:1122:3344:101::3, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 68c29e6d-6134-4678-be81-fd53901e9105, underlay_address: fd00:1122:3344:101::4, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External } } } }, OmicronZoneConfig { id: afb193bd-2840-4e76-a967-0dee9f03c40c, underlay_address: fd00:1122:3344:101::5, filesystem_pool: Some(ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External } } } }, OmicronZoneConfig { id: a0cd76dd-890f-40d6-b9c9-466b1152d492, underlay_address: fd00:1122:3344:101::6, filesystem_pool: Some(ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External } } } }, OmicronZoneConfig { id: 19bd4462-2353-4408-860c-54bff4d4af2c, underlay_address: fd00:1122:3344:101::7, filesystem_pool: Some(ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External } } } }, OmicronZoneConfig { id: f5aef115-6099-4bcb-838b-81bfab4449ed, underlay_address: fd00:1122:3344:101::8, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b, underlay_address: fd00:1122:3344:101::9, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f, underlay_address: fd00:1122:3344:101::a, filesystem_pool: Some(ZpoolName { id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8f71618e-4655-4b1f-8c0f-30077456ab98, underlay_address: fd00:1122:3344:101::b, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9, underlay_address: fd00:1122:3344:101::c, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4acc4057-9e37-454f-b1dd-7cbe37073be1, underlay_address: fd00:1122:3344:101::d, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 5f32aeb8-edfa-4634-84f3-36483d82636e, underlay_address: fd00:1122:3344:101::e, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: d726e303-2a8a-466b-a41e-367c1176c197, underlay_address: fd00:1122:3344:101::f, filesystem_pool: Some(ZpoolName { id: c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: a56394f5-7075-45b8-8ce9-9ff635ea6a83, underlay_address: fd00:1122:3344:101::10, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74, underlay_address: fd00:1122:3344:101::11, filesystem_pool: Some(ZpoolName { id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 347b0d1a-0db7-4863-ad66-da80077239f6, underlay_address: fd00:1122:3344:101::12, filesystem_pool: Some(ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External } } } }, OmicronZoneConfig { id: c21b35d0-f29d-4817-9181-69aea340b2f2, underlay_address: fd00:1122:3344:101::13, filesystem_pool: Some(ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ace4d6b-145f-45f4-87f5-a29c3703a710, underlay_address: fd00:1122:3344:101::14, filesystem_pool: Some(ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External } } } }, OmicronZoneConfig { id: 6491e072-2069-43dd-9182-395802f8163c, underlay_address: fd00:1122:3344:101::15, filesystem_pool: Some(ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External } } } }, OmicronZoneConfig { id: cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2, underlay_address: fd00:1122:3344:101::16, filesystem_pool: Some(ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External } } } }, OmicronZoneConfig { id: aae813e6-568f-443c-83f5-5f2e20df0ff2, underlay_address: fd00:1122:3344:101::17, filesystem_pool: Some(ZpoolName { id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool), kind: External } } } }, OmicronZoneConfig { id: 064b1447-702f-4f88-b0e7-1552e0564dfb, underlay_address: fd00:1122:3344:101::18, filesystem_pool: Some(ZpoolName { id: 030f20e2-2758-4a47-92fd-4adaf0953899 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 030f20e2-2758-4a47-92fd-4adaf0953899 (zpool), kind: External } } } }, OmicronZoneConfig { id: 500d8529-7595-4c83-9854-2baf5d4b40b4, underlay_address: fd00:1122:3344:101::19, filesystem_pool: Some(ZpoolName { id: a954bc02-0277-475f-b5f2-befa522b2371 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: a954bc02-0277-475f-b5f2-befa522b2371 (zpool), kind: External } } } }, OmicronZoneConfig { id: 116e07d8-bb28-43dc-b2c5-373fb70d2398, underlay_address: fd00:1122:3344:101::1a, filesystem_pool: Some(ZpoolName { id: c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:438 sled_address = [fd00:1122:3344:101::1]:12345
8902024-08-27T19:01:37.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52129
8912024-08-27T19:01:37.642ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8922024-08-27T19:01:37.642ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 12e0dbff-dd84-4a1b-a5ad-e177fcf2fe2f, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8932024-08-27T19:01:37.669ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8942024-08-27T19:01:37.669ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: b3dbba6d-9a3b-4f7b-ae1b-4e23ce834426, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: InternalDns }, responder: ... }
8952024-08-27T19:01:37.689ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8962024-08-27T19:01:37.689ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 28126e25-07e2-4032-8ea4-b0e36ed725b7, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: InternalDns }, responder: ... }
8972024-08-27T19:01:37.708ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: dae07c98-fe1f-4226-b25a-884690e85195, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8982024-08-27T19:01:37.708ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: dae07c98-fe1f-4226-b25a-884690e85195, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8992024-08-27T19:01:37.727ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 68c29e6d-6134-4678-be81-fd53901e9105, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
9002024-08-27T19:01:37.727ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 68c29e6d-6134-4678-be81-fd53901e9105, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9012024-08-27T19:01:37.745ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: afb193bd-2840-4e76-a967-0dee9f03c40c, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
9022024-08-27T19:01:37.745ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: afb193bd-2840-4e76-a967-0dee9f03c40c, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9032024-08-27T19:01:37.764ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a0cd76dd-890f-40d6-b9c9-466b1152d492, dataset_name: DatasetName { pool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
9042024-08-27T19:01:37.764ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: a0cd76dd-890f-40d6-b9c9-466b1152d492, dataset_name: DatasetName { pool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9052024-08-27T19:01:37.783ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 19bd4462-2353-4408-860c-54bff4d4af2c, dataset_name: DatasetName { pool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
9062024-08-27T19:01:37.783ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 19bd4462-2353-4408-860c-54bff4d4af2c, dataset_name: DatasetName { pool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
9072024-08-27T19:01:37.801ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f5aef115-6099-4bcb-838b-81bfab4449ed, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
9082024-08-27T19:01:37.801ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: f5aef115-6099-4bcb-838b-81bfab4449ed, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9092024-08-27T19:01:37.897ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5b9ebccd-158f-465d-9f58-f826eef0b95b, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
9102024-08-27T19:01:37.897ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 5b9ebccd-158f-465d-9f58-f826eef0b95b, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: ExternalDns }, responder: ... }
9112024-08-27T19:01:37.993ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5f32aeb8-edfa-4634-84f3-36483d82636e, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:406
9122024-08-27T19:01:37.993ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 5f32aeb8-edfa-4634-84f3-36483d82636e, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
9132024-08-27T19:01:38.110ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 347b0d1a-0db7-4863-ad66-da80077239f6, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9142024-08-27T19:01:38.110ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 347b0d1a-0db7-4863-ad66-da80077239f6, dataset_name: DatasetName { pool_name: ZpoolName { id: da7c3e21-7c55-491f-981e-80aa62a13bf6 (zpool), kind: External }, kind: Crucible }, responder: ... }
9152024-08-27T19:01:38.196ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: c21b35d0-f29d-4817-9181-69aea340b2f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9162024-08-27T19:01:38.196ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: c21b35d0-f29d-4817-9181-69aea340b2f2, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e (zpool), kind: External }, kind: Crucible }, responder: ... }
9172024-08-27T19:01:38.278ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5ace4d6b-145f-45f4-87f5-a29c3703a710, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9182024-08-27T19:01:38.278ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 5ace4d6b-145f-45f4-87f5-a29c3703a710, dataset_name: DatasetName { pool_name: ZpoolName { id: 558a4fa3-16b9-4e7c-8ac0-a40723ece2de (zpool), kind: External }, kind: Crucible }, responder: ... }
9192024-08-27T19:01:38.359ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6491e072-2069-43dd-9182-395802f8163c, dataset_name: DatasetName { pool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9202024-08-27T19:01:38.359ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 6491e072-2069-43dd-9182-395802f8163c, dataset_name: DatasetName { pool_name: ZpoolName { id: c75d3f85-2b4d-4485-aa90-58be246da1bc (zpool), kind: External }, kind: Crucible }, responder: ... }
9212024-08-27T19:01:38.458ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2, dataset_name: DatasetName { pool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9222024-08-27T19:01:38.458ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2, dataset_name: DatasetName { pool_name: ZpoolName { id: ece87f46-247e-409b-ad26-6e8e96c7e756 (zpool), kind: External }, kind: Crucible }, responder: ... }
9232024-08-27T19:01:38.573ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: aae813e6-568f-443c-83f5-5f2e20df0ff2, dataset_name: DatasetName { pool_name: ZpoolName { id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9242024-08-27T19:01:38.573ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: aae813e6-568f-443c-83f5-5f2e20df0ff2, dataset_name: DatasetName { pool_name: ZpoolName { id: 6a874446-59c2-4b92-800d-d0a1bfbe68dd (zpool), kind: External }, kind: Crucible }, responder: ... }
9252024-08-27T19:01:38.685ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 064b1447-702f-4f88-b0e7-1552e0564dfb, dataset_name: DatasetName { pool_name: ZpoolName { id: 030f20e2-2758-4a47-92fd-4adaf0953899 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9262024-08-27T19:01:38.685ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 064b1447-702f-4f88-b0e7-1552e0564dfb, dataset_name: DatasetName { pool_name: ZpoolName { id: 030f20e2-2758-4a47-92fd-4adaf0953899 (zpool), kind: External }, kind: Crucible }, responder: ... }
9272024-08-27T19:01:38.798ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 500d8529-7595-4c83-9854-2baf5d4b40b4, dataset_name: DatasetName { pool_name: ZpoolName { id: a954bc02-0277-475f-b5f2-befa522b2371 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9282024-08-27T19:01:38.798ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 500d8529-7595-4c83-9854-2baf5d4b40b4, dataset_name: DatasetName { pool_name: ZpoolName { id: a954bc02-0277-475f-b5f2-befa522b2371 (zpool), kind: External }, kind: Crucible }, responder: ... }
9292024-08-27T19:01:38.919ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 116e07d8-bb28-43dc-b2c5-373fb70d2398, dataset_name: DatasetName { pool_name: ZpoolName { id: c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
9302024-08-27T19:01:38.919ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:773 request = NewFilesystemRequest { dataset_id: 116e07d8-bb28-43dc-b2c5-373fb70d2398, dataset_name: DatasetName { pool_name: ZpoolName { id: c21168f7-9204-4a38-9c41-94555fc3bf91 (zpool), kind: External }, kind: Crucible }, responder: ... }
9312024-08-27T19:01:39.031ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9322024-08-27T19:01:39.031ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/omicron-zones.json file = common/src/ledger.rs:177
9332024-08-27T19:01:39.032ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/omicron-zones.json file = common/src/ledger.rs:177
9342024-08-27T19:01:39.032ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9352024-08-27T19:01:39.160ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9362024-08-27T19:01:39.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9372024-08-27T19:01:39.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9382024-08-27T19:01:39.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9392024-08-27T19:01:39.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9402024-08-27T19:01:39.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9412024-08-27T19:01:39.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9422024-08-27T19:01:39.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9432024-08-27T19:01:39.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9442024-08-27T19:01:39.259ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9452024-08-27T19:01:39.463ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9462024-08-27T19:01:39.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9472024-08-27T19:01:39.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9482024-08-27T19:01:39.475ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9492024-08-27T19:01:39.477ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9502024-08-27T19:01:39.478ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:260
9512024-08-27T19:01:39.492ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9522024-08-27T19:01:39.492ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9532024-08-27T19:01:39.492ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9542024-08-27T19:01:39.495ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e file = illumos-utils/src/zone.rs:316
9552024-08-27T19:01:39.500ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2 file = illumos-utils/src/zone.rs:316
9562024-08-27T19:01:39.506ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb file = illumos-utils/src/zone.rs:316
9572024-08-27T19:01:39.511ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6491e072-2069-43dd-9182-395802f8163c file = illumos-utils/src/zone.rs:316
9582024-08-27T19:01:39.517ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4 file = illumos-utils/src/zone.rs:316
9592024-08-27T19:01:39.522ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83 file = illumos-utils/src/zone.rs:316
9602024-08-27T19:01:39.527ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2 file = illumos-utils/src/zone.rs:316
9612024-08-27T19:01:39.532ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398 file = illumos-utils/src/zone.rs:316
9622024-08-27T19:01:39.538ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710 file = illumos-utils/src/zone.rs:316
9632024-08-27T19:01:39.642ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e file = illumos-utils/src/zone.rs:354
9642024-08-27T19:01:39.647ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2 file = illumos-utils/src/zone.rs:354
9652024-08-27T19:01:39.653ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb file = illumos-utils/src/zone.rs:354
9662024-08-27T19:01:39.657ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6491e072-2069-43dd-9182-395802f8163c file = illumos-utils/src/zone.rs:354
9672024-08-27T19:01:39.661ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4 file = illumos-utils/src/zone.rs:354
9682024-08-27T19:01:39.666ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83 file = illumos-utils/src/zone.rs:354
9692024-08-27T19:01:39.671ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2 file = illumos-utils/src/zone.rs:354
9702024-08-27T19:01:39.676ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398 file = illumos-utils/src/zone.rs:354
9712024-08-27T19:01:39.680ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710 file = illumos-utils/src/zone.rs:354
9722024-08-27T19:01:39.686ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1 file = illumos-utils/src/zone.rs:316
9732024-08-27T19:01:39.691ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2 file = illumos-utils/src/zone.rs:316
9742024-08-27T19:01:39.697ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197 file = illumos-utils/src/zone.rs:316
9752024-08-27T19:01:39.703ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74 file = illumos-utils/src/zone.rs:316
9762024-08-27T19:01:39.708ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6 file = illumos-utils/src/zone.rs:316
9772024-08-27T19:01:39.755ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9782024-08-27T19:01:39.756ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1 file = illumos-utils/src/zone.rs:354
9792024-08-27T19:01:39.761ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2 file = illumos-utils/src/zone.rs:354
9802024-08-27T19:01:39.767ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197 file = illumos-utils/src/zone.rs:354
9812024-08-27T19:01:39.773ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74 file = illumos-utils/src/zone.rs:354
9822024-08-27T19:01:39.778ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6 file = illumos-utils/src/zone.rs:354
9832024-08-27T19:01:39.826ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9842024-08-27T19:01:39.876ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9852024-08-27T19:01:39.942ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9862024-08-27T19:01:40.007ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:277
9872024-08-27T19:01:40.010ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9882024-08-27T19:01:40.010ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9892024-08-27T19:01:40.076ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 220, 196]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9902024-08-27T19:01:40.076ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = nexus
9912024-08-27T19:01:40.080ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9922024-08-27T19:01:40.080ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9932024-08-27T19:01:40.146ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 191, 90]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
9942024-08-27T19:01:40.146ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = external_dns
9952024-08-27T19:01:40.151ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
9962024-08-27T19:01:40.152ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
9972024-08-27T19:01:40.223ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 211, 52]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
9982024-08-27T19:01:40.223ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = nexus
9992024-08-27T19:01:40.228ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10002024-08-27T19:01:40.228ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10012024-08-27T19:01:40.298ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 130, 53]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
10022024-08-27T19:01:40.298ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = external_dns
10032024-08-27T19:01:40.300ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:302
10042024-08-27T19:01:40.300ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:194
10052024-08-27T19:01:40.357ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 202, 156]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
10062024-08-27T19:01:40.357ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1235 zone_type = nexus
10072024-08-27T19:01:40.357ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
10082024-08-27T19:01:40.357ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
10092024-08-27T19:01:40.358ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
10102024-08-27T19:01:40.358ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
10112024-08-27T19:01:40.358ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
10122024-08-27T19:01:40.358ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
10132024-08-27T19:01:40.360ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
10142024-08-27T19:01:40.361ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
10152024-08-27T19:01:40.361ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
10162024-08-27T19:01:40.361ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
10172024-08-27T19:01:40.377ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
10182024-08-27T19:01:40.379ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
10192024-08-27T19:01:40.383ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
10202024-08-27T19:01:40.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
10212024-08-27T19:01:40.384ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
10222024-08-27T19:01:40.386ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
10232024-08-27T19:01:40.389ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
10242024-08-27T19:01:40.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
10252024-08-27T19:01:40.389ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
10262024-08-27T19:01:40.392ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
10272024-08-27T19:01:40.641ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f file = illumos-utils/src/zone.rs:316
10282024-08-27T19:01:40.655ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed file = illumos-utils/src/zone.rs:316
10292024-08-27T19:01:40.665ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b file = illumos-utils/src/zone.rs:316
10302024-08-27T19:01:40.678ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98 file = illumos-utils/src/zone.rs:316
10312024-08-27T19:01:40.693ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 file = illumos-utils/src/zone.rs:316
10322024-08-27T19:01:40.706ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f file = illumos-utils/src/zone.rs:354
10332024-08-27T19:01:40.717ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed file = illumos-utils/src/zone.rs:354
10342024-08-27T19:01:40.730ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b file = illumos-utils/src/zone.rs:354
10352024-08-27T19:01:40.749ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98 file = illumos-utils/src/zone.rs:354
10362024-08-27T19:01:40.768ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 file = illumos-utils/src/zone.rs:354
10372024-08-27T19:01:43.429ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10382024-08-27T19:01:43.430ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10392024-08-27T19:01:43.432ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
10402024-08-27T19:01:43.443ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
10412024-08-27T19:01:43.541ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d8983f3d-772b-439d-a103-49ec567431a4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10422024-08-27T19:01:43.541ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6a874446-59c2-4b92-800d-d0a1bfbe68dd/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6874151a-a0cf-40a2-9e79-bd7f20060193'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10432024-08-27T19:01:43.542ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_030f20e2-2758-4a47-92fd-4adaf0953899/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0fe088b5-60d6-434d-b182-2e916ca422b3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10442024-08-27T19:01:43.542ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6491e072-2069-43dd-9182-395802f8163c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c75d3f85-2b4d-4485-aa90-58be246da1bc/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='f2fe4d84-1780-426e-bb2d-7f8486667f32'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10452024-08-27T19:01:43.542ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_a954bc02-0277-475f-b5f2-befa522b2371/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ca413dd9-1e0e-48c8-9ae6-9438e1d2b52e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10462024-08-27T19:01:43.542ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ece87f46-247e-409b-ad26-6e8e96c7e756/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3ec52be8-f532-428f-84bf-ca25e55d6757'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10472024-08-27T19:01:43.542ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_c21168f7-9204-4a38-9c41-94555fc3bf91/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='d451f413-52b7-4b14-8d4a-1e3bfacf7f36'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10482024-08-27T19:01:43.543ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_558a4fa3-16b9-4e7c-8ac0-a40723ece2de/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='3e6b0bc0-5eda-4667-b951-50f012871691'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10492024-08-27T19:01:43.543ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
10502024-08-27T19:01:43.551ZINFOSledAgent (ServiceManager): Booting oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
10512024-08-27T19:01:43.560ZINFOSledAgent (ServiceManager): Booting oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
10522024-08-27T19:01:43.569ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6491e072-2069-43dd-9182-395802f8163c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
10532024-08-27T19:01:43.577ZINFOSledAgent (ServiceManager): Booting oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
10542024-08-27T19:01:43.585ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10552024-08-27T19:01:43.585ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
10562024-08-27T19:01:43.592ZINFOSledAgent (ServiceManager): Booting oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
10572024-08-27T19:01:43.600ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
10582024-08-27T19:01:43.608ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_da7c3e21-7c55-491f-981e-80aa62a13bf6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7de5faaf-ec28-411e-ad98-c4f9bbf2f011'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10592024-08-27T19:01:43.608ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
10602024-08-27T19:01:43.615ZINFOSledAgent (ServiceManager): Booting oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
10612024-08-27T19:01:43.737ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='4acc4057-9e37-454f-b1dd-7cbe37073be1'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622024-08-27T19:01:43.738ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
10632024-08-27T19:01:43.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 50.941915ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
10642024-08-27T19:01:43.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 39.137072ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
10652024-08-27T19:01:43.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 58.35084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
10662024-08-27T19:01:43.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 45.724581ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
10672024-08-27T19:01:43.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 74.287663ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
10682024-08-27T19:01:43.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 34.947478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
10692024-08-27T19:01:43.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 52.460378ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
10702024-08-27T19:01:44.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 58.4001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
10712024-08-27T19:01:44.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 29.622446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
10722024-08-27T19:01:50.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 37.412255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
10732024-08-27T19:01:50.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 45.372351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
10742024-08-27T19:01:51.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 49.344119ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
10752024-08-27T19:01:51.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 54.285277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
10762024-08-27T19:01:51.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 102.501714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
10772024-08-27T19:01:52.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 127.386448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
10782024-08-27T19:01:52.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 81.98545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
10792024-08-27T19:01:52.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 107.033522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
10802024-08-27T19:01:52.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 137.831033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
10812024-08-27T19:01:52.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 75.791382ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
10822024-08-27T19:01:52.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 87.468099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
10832024-08-27T19:01:52.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 41.259306ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
10842024-08-27T19:01:52.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 95.016192ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
10852024-08-27T19:01:52.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 99.084883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
10862024-08-27T19:01:52.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 128.616894ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
10872024-08-27T19:01:52.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 77.936197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
10882024-08-27T19:01:52.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 198.548621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
10892024-08-27T19:01:52.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 213.988558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
10902024-08-27T19:01:52.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 135.646494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
10912024-08-27T19:01:52.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 293.701609ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
10922024-08-27T19:01:52.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 297.675615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
10932024-08-27T19:01:52.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 114.713992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
10942024-08-27T19:01:52.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 169.752272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
10952024-08-27T19:01:52.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 181.350857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
10962024-08-27T19:01:52.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 130.713771ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
10972024-08-27T19:01:52.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 213.28336ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
10982024-08-27T19:01:52.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 154.713494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
10992024-08-27T19:01:52.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 225.41664ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
11002024-08-27T19:01:52.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 131.696828ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
11012024-08-27T19:01:52.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 329.614714ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
11022024-08-27T19:01:52.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 285.952563ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
11032024-08-27T19:01:52.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 422.323967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
11042024-08-27T19:01:52.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 577.543092ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
11052024-08-27T19:01:52.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 201.65467ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
11062024-08-27T19:01:52.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 302.52816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
11072024-08-27T19:01:52.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 560.406278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
11082024-08-27T19:01:52.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 277.409549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
11092024-08-27T19:01:52.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 229.861077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
11102024-08-27T19:01:53.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 341.430775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
11112024-08-27T19:01:53.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 530.375024ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
11122024-08-27T19:01:53.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 419.644148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
11132024-08-27T19:01:53.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 591.696921ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
11142024-08-27T19:01:53.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 485.64893ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
11152024-08-27T19:01:53.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 1.176883289s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
11162024-08-27T19:01:53.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 890.086374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
11172024-08-27T19:01:53.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 792.263225ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
11182024-08-27T19:01:53.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 475.14827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
11192024-08-27T19:01:53.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 703.417706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
11202024-08-27T19:01:53.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 601.375206ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
11212024-08-27T19:01:53.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 972.336278ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
11222024-08-27T19:01:53.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 721.589584ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
11232024-08-27T19:01:53.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 1.129101934s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
11242024-08-27T19:01:53.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 591.696381ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
11252024-08-27T19:01:53.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 740.388797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
11262024-08-27T19:01:53.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 703.944689ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
11272024-08-27T19:01:53.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 973.063903ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
11282024-08-27T19:01:53.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 698.948053ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
11292024-08-27T19:01:53.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 1.450695297s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
11302024-08-27T19:01:54.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 616.596003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
11312024-08-27T19:01:54.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 920.36049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
11322024-08-27T19:01:54.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 1.199515393s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
11332024-08-27T19:01:54.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 838.092571ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
11342024-08-27T19:01:54.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 1.40667979s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
11352024-08-27T19:01:54.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 1.414225965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
11362024-08-27T19:01:54.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 1.387814221s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
11372024-08-27T19:01:54.444ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 725.156838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
11382024-08-27T19:01:54.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 712.960524ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
11392024-08-27T19:01:54.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 1.319626262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
11402024-08-27T19:01:54.488ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11412024-08-27T19:01:54.490ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
11422024-08-27T19:01:54.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 1.496161041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
11432024-08-27T19:01:54.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 1.19625588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
11442024-08-27T19:01:54.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.036792111s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
11452024-08-27T19:01:54.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 71.734775ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
11462024-08-27T19:01:54.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 83.936478ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
11472024-08-27T19:01:54.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 906.988153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
11482024-08-27T19:01:55.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 1.259742149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
11492024-08-27T19:01:55.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 138.712285ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
11502024-08-27T19:01:55.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 694.272833ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
11512024-08-27T19:01:55.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 1.1431193s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
11522024-08-27T19:01:55.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 447.291934ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
11532024-08-27T19:01:55.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 1.21625268s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
11542024-08-27T19:01:55.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 1.223282896s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
11552024-08-27T19:01:55.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 1.433491672s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
11562024-08-27T19:01:55.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 493.544614ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
11572024-08-27T19:01:55.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.148402186s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
11582024-08-27T19:01:55.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 688.699188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
11592024-08-27T19:01:55.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 887.054144ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
11602024-08-27T19:01:55.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 721.892992ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
11612024-08-27T19:01:55.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 1.003350249s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
11622024-08-27T19:01:55.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 629.133952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
11632024-08-27T19:01:55.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 1.13276715s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
11642024-08-27T19:01:55.927ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11652024-08-27T19:01:55.927ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
11662024-08-27T19:01:56.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 751.349147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
11672024-08-27T19:01:56.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 57.428393ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
11682024-08-27T19:01:56.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 805.226958ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
11692024-08-27T19:01:56.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 139.288809ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
11702024-08-27T19:01:56.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 1.036730945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
11712024-08-27T19:01:56.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 631.653232ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
11722024-08-27T19:01:56.366ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11732024-08-27T19:01:56.366ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
11742024-08-27T19:01:56.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 151.105915ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
11752024-08-27T19:01:56.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 1.278085193s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
11762024-08-27T19:01:56.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 732.810283ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
11772024-08-27T19:01:56.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 769.831472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
11782024-08-27T19:01:56.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 663.455583ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
11792024-08-27T19:01:56.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 517.37338ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
11802024-08-27T19:01:56.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 73.455885ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
11812024-08-27T19:01:56.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 547.250635ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
11822024-08-27T19:01:56.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 87.939281ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
11832024-08-27T19:01:56.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 1.337234255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
11842024-08-27T19:01:56.820ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 19.628594601s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:424 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
11852024-08-27T19:01:56.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 287.628433ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
11862024-08-27T19:01:56.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 1.478129094s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
11872024-08-27T19:01:56.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.138187604s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
11882024-08-27T19:01:56.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 1.183786451s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
11892024-08-27T19:01:57.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 512.417343ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
11902024-08-27T19:01:57.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 808.274091ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
11912024-08-27T19:01:57.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 632.230957ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
11922024-08-27T19:01:57.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 698.988479ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
11932024-08-27T19:01:57.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 1.357935772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
11942024-08-27T19:01:57.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 379.311575ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
11952024-08-27T19:01:57.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 676.783286ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
11962024-08-27T19:01:57.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 1.231004764s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
11972024-08-27T19:01:57.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 1.200574133s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
11982024-08-27T19:01:57.311ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11992024-08-27T19:01:57.311ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
12002024-08-27T19:01:57.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 663.624298ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
12012024-08-27T19:01:57.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 1.24296428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
12022024-08-27T19:01:57.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 1.088885918s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
12032024-08-27T19:01:57.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 562.094786ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
12042024-08-27T19:01:57.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 26.666133ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
12052024-08-27T19:01:57.612ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12062024-08-27T19:01:57.612ZINFOSledAgent (ServiceManager): Booting oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
12072024-08-27T19:01:57.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 78.577098ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
12082024-08-27T19:01:57.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 1.321103316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
12092024-08-27T19:01:57.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 217.674348ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
12102024-08-27T19:01:57.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 1.197686407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
12112024-08-27T19:01:57.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 1.298280814s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
12122024-08-27T19:01:57.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 1.137296947s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
12132024-08-27T19:01:57.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 892.503144ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
12142024-08-27T19:01:57.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 31.321471ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
12152024-08-27T19:01:58.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 799.875318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
12162024-08-27T19:01:58.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 373.470456ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
12172024-08-27T19:01:58.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 148.037298ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
12182024-08-27T19:01:58.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.477999093s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
12192024-08-27T19:01:58.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 1.04442744s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
12202024-08-27T19:01:58.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 890.303643ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
12212024-08-27T19:01:58.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 223.414222ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
12222024-08-27T19:01:58.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 650.524256ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
12232024-08-27T19:01:58.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 674.816587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
12242024-08-27T19:01:58.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 506.402716ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
12252024-08-27T19:01:58.463ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:2::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="clickhouse_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12262024-08-27T19:01:58.465ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
12272024-08-27T19:01:58.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 494.132733ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
12282024-08-27T19:01:58.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 1.398124636s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
12292024-08-27T19:01:58.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 1.235546308s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
12302024-08-27T19:01:58.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 1.496969278s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
12312024-08-27T19:01:58.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 914.196409ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
12322024-08-27T19:01:58.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 516.148031ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
12332024-08-27T19:01:58.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 56.737734ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
12342024-08-27T19:01:58.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 107.633898ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
12352024-08-27T19:01:58.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 996.174782ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
12362024-08-27T19:01:58.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 1.134961232s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
12372024-08-27T19:01:58.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 899.535141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
12382024-08-27T19:01:58.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 237.260615ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
12392024-08-27T19:01:58.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 1.351887093s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
12402024-08-27T19:01:59.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 861.743563ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
12412024-08-27T19:01:59.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 972.007374ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
12422024-08-27T19:01:59.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 1.180240118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
12432024-08-27T19:01:59.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 998.95893ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
12442024-08-27T19:01:59.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 1.347567167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
12452024-08-27T19:01:59.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 890.449809ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
12462024-08-27T19:01:59.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 993.434757ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
12472024-08-27T19:01:59.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 417.37496ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
12482024-08-27T19:01:59.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 1.293857897s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
12492024-08-27T19:01:59.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 1.186100145s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
12502024-08-27T19:01:59.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 1.294871447s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
12512024-08-27T19:01:59.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 784.43789ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
12522024-08-27T19:01:59.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 1.196557131s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
12532024-08-27T19:01:59.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 776.888478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
12542024-08-27T19:01:59.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 1.167805096s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
12552024-08-27T19:01:59.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 1.322942112s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
12562024-08-27T19:01:59.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 1.470107189s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
12572024-08-27T19:01:59.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 1.329188322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
12582024-08-27T19:02:00.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 908.357359ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
12592024-08-27T19:02:00.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 773.748522ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
12602024-08-27T19:02:00.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 1.051134817s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
12612024-08-27T19:02:00.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 649.639603ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
12622024-08-27T19:02:00.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 1.353322695s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
12632024-08-27T19:02:00.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 1.131549418s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
12642024-08-27T19:02:00.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 591.434967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
12652024-08-27T19:02:00.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 1.252054715s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
12662024-08-27T19:02:00.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 785.726874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
12672024-08-27T19:02:00.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 1.362214468s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
12682024-08-27T19:02:00.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 1.118343472s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
12692024-08-27T19:02:00.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 1.007309042s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
12702024-08-27T19:02:00.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 514.214478ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
12712024-08-27T19:02:00.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 1.106898971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
12722024-08-27T19:02:00.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 1.225295781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
12732024-08-27T19:02:00.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 1.293561224s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
12742024-08-27T19:02:00.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 822.72097ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
12752024-08-27T19:02:00.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 737.832292ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
12762024-08-27T19:02:00.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 894.46528ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
12772024-08-27T19:02:01.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 1.400350272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
12782024-08-27T19:02:01.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 744.37139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
12792024-08-27T19:02:01.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 1.211579239s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
12802024-08-27T19:02:01.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.005376797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
12812024-08-27T19:02:01.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 868.750125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
12822024-08-27T19:02:01.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 1.455839932s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
12832024-08-27T19:02:01.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 515.221428ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
12842024-08-27T19:02:01.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 1.307585257s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
12852024-08-27T19:02:01.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 518.918766ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
12862024-08-27T19:02:01.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 1.2717574s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
12872024-08-27T19:02:01.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 1.280427873s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
12882024-08-27T19:02:01.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 1.366509593s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
12892024-08-27T19:02:01.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 547.551569ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
12902024-08-27T19:02:01.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 740.858801ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
12912024-08-27T19:02:01.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 1.085628497s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
12922024-08-27T19:02:01.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 1.317649443s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
12932024-08-27T19:02:01.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 706.530216ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
12942024-08-27T19:02:01.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 981.03208ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
12952024-08-27T19:02:01.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 1.452018282s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
12962024-08-27T19:02:02.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 767.094944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
12972024-08-27T19:02:02.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 1.357420671s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
12982024-08-27T19:02:02.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 882.115616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
12992024-08-27T19:02:02.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 974.369615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
13002024-08-27T19:02:02.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 1.145656885s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
13012024-08-27T19:02:02.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.116674141s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
13022024-08-27T19:02:02.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 942.790929ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
13032024-08-27T19:02:02.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197") failed: Property not found. retry in 888.544775ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
13042024-08-27T19:02:02.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 642.569739ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
13052024-08-27T19:02:02.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 973.164586ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
13062024-08-27T19:02:02.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 745.216893ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
13072024-08-27T19:02:02.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 1.35704428s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
13082024-08-27T19:02:02.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 835.007601ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
13092024-08-27T19:02:02.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 908.270684ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
13102024-08-27T19:02:02.906ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 1.406593217s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
13112024-08-27T19:02:02.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 902.209131ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
13122024-08-27T19:02:02.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 806.234557ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
13132024-08-27T19:02:03.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 1.17496765s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
13142024-08-27T19:02:03.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 1.076375226s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
13152024-08-27T19:02:03.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 718.449441ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
13162024-08-27T19:02:03.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 1.443302651s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
13172024-08-27T19:02:03.210ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 1.05469085s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
13182024-08-27T19:02:03.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1") failed: Property not found. retry in 757.93098ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
13192024-08-27T19:02:03.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 765.766733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
13202024-08-27T19:02:03.381ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 682.697138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
13212024-08-27T19:02:03.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 738.382468ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
13222024-08-27T19:02:03.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 633.561722ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
13232024-08-27T19:02:03.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 1.046139348s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
13242024-08-27T19:02:03.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 570.487297ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
13252024-08-27T19:02:03.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 1.429864843s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
13262024-08-27T19:02:03.785ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 635.653996ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
13272024-08-27T19:02:03.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 523.319906ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
13282024-08-27T19:02:03.834ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 1.050651902s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
13292024-08-27T19:02:03.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 1.383169099s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
13302024-08-27T19:02:04.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 1.106338189s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
13312024-08-27T19:02:04.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 1.422395127s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
13322024-08-27T19:02:04.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 1.239987905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
13332024-08-27T19:02:04.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 803.774938ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
13342024-08-27T19:02:04.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.17629005s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
13352024-08-27T19:02:04.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 1.020640855s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
13362024-08-27T19:02:04.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 597.22382ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
13372024-08-27T19:02:04.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 867.577445ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
13382024-08-27T19:02:04.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 1.319434561s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
13392024-08-27T19:02:04.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 1.297034875s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
13402024-08-27T19:02:04.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 572.939813ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
13412024-08-27T19:02:04.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 694.810617ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
13422024-08-27T19:02:04.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 798.482585ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
13432024-08-27T19:02:04.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 812.572012ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
13442024-08-27T19:02:04.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 1.403380406s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
13452024-08-27T19:02:04.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 1.161435481s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
13462024-08-27T19:02:04.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 1.077056782s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
13472024-08-27T19:02:04.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 566.051247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
13482024-08-27T19:02:05.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 907.205944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
13492024-08-27T19:02:05.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 526.02184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
13502024-08-27T19:02:05.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 595.606242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
13512024-08-27T19:02:05.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 1.042928707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
13522024-08-27T19:02:05.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 1.234097523s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
13532024-08-27T19:02:05.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 1.052013237s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
13542024-08-27T19:02:05.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 528.925414ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
13552024-08-27T19:02:05.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 954.94163ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
13562024-08-27T19:02:05.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 768.856629ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
13572024-08-27T19:02:05.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 870.490994ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
13582024-08-27T19:02:05.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 1.147369924s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
13592024-08-27T19:02:05.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 788.553466ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
13602024-08-27T19:02:05.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 920.268719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
13612024-08-27T19:02:05.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 680.089857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
13622024-08-27T19:02:05.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 1.17587975s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
13632024-08-27T19:02:05.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 950.705694ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
13642024-08-27T19:02:05.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.001515122s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
13652024-08-27T19:02:05.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 567.796576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
13662024-08-27T19:02:06.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 1.3413779s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
13672024-08-27T19:02:06.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 1.068254842s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
13682024-08-27T19:02:06.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 1.411603441s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
13692024-08-27T19:02:06.206ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 1.333599327s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
13702024-08-27T19:02:06.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 1.471054766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
13712024-08-27T19:02:06.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 1.382480471s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
13722024-08-27T19:02:06.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 941.276803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
13732024-08-27T19:02:06.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 760.448924ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
13742024-08-27T19:02:06.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 1.239072445s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
13752024-08-27T19:02:06.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 1.23361434s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
13762024-08-27T19:02:06.434ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 1.420447041s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
13772024-08-27T19:02:06.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 729.627749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
13782024-08-27T19:02:06.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 606.538112ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
13792024-08-27T19:02:06.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 1.071116959s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
13802024-08-27T19:02:06.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 1.163898356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
13812024-08-27T19:02:06.821ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 1.442113804s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
13822024-08-27T19:02:06.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.117761183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
13832024-08-27T19:02:07.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6491e072-2069-43dd-9182-395802f8163c") failed: Property not found. retry in 1.002260692s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
13842024-08-27T19:02:07.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 573.659464ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
13852024-08-27T19:02:07.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 908.157841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
13862024-08-27T19:02:07.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 932.342701ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
13872024-08-27T19:02:07.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 1.479153802s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
13882024-08-27T19:02:07.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 1.319553189s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
13892024-08-27T19:02:07.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 843.570445ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
13902024-08-27T19:02:07.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 916.270317ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
13912024-08-27T19:02:07.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 1.322373058s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
13922024-08-27T19:02:07.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 1.255707462s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
13932024-08-27T19:02:07.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 1.42064318s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
13942024-08-27T19:02:07.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 837.504836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
13952024-08-27T19:02:07.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 683.020345ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
13962024-08-27T19:02:07.737ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43861
13972024-08-27T19:02:07.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710") failed: Property not found. retry in 700.768242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
13982024-08-27T19:02:07.766ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 14741 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43861 req_id = ce56300d-7d2a-4141-889f-34e5db9731de response_code = 200 uri = /baseboard
13992024-08-27T19:02:07.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 864.402475ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
14002024-08-27T19:02:07.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 910.239244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
14012024-08-27T19:02:08.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 540.340125ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
14022024-08-27T19:02:08.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 894.039881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
14032024-08-27T19:02:08.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f") failed: Property not found. retry in 970.833489ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
14042024-08-27T19:02:08.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb") failed: Property not found. retry in 1.493519262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
14052024-08-27T19:02:08.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 680.489587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
14062024-08-27T19:02:08.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2") failed: Property not found. retry in 631.213762ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
14072024-08-27T19:02:08.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed") failed: Property not found. retry in 1.073328182s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
14082024-08-27T19:02:08.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b") failed: Property not found. retry in 1.05970576s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
14092024-08-27T19:02:08.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 971.315081ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
14102024-08-27T19:02:08.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74") failed: Property not found. retry in 1.411892465s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
14112024-08-27T19:02:08.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2") failed: Property not found. retry in 1.402692128s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
14122024-08-27T19:02:08.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 959.077492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
14132024-08-27T19:02:08.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6") failed: Property not found. retry in 1.035956707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
14142024-08-27T19:02:08.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398") failed: Property not found. retry in 1.172055989s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
14152024-08-27T19:02:08.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 827.423726ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
14162024-08-27T19:02:09.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4") failed: Property not found. retry in 588.637876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
14172024-08-27T19:02:09.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 827.211527ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
14182024-08-27T19:02:09.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2") failed: Property not found. retry in 1.016953155s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
14192024-08-27T19:02:09.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 1.033284167s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
14202024-08-27T19:02:09.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83") failed: Property not found. retry in 847.494925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
14212024-08-27T19:02:09.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 1.36606935s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
14222024-08-27T19:02:09.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9") failed: Property not found. retry in 1.401335644s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
14232024-08-27T19:02:10.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98") failed: Property not found. retry in 1.456102845s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
14242024-08-27T19:02:11.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 966.963467ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
14252024-08-27T19:02:12.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e") failed: Property not found. retry in 914.414419ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
14262024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_nexus_3c5b8b32-bf96-417e-9684-a3bde590c61f
14272024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_clickhouse_5f32aeb8-edfa-4634-84f3-36483d82636e
14282024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_aae813e6-568f-443c-83f5-5f2e20df0ff2
14292024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_064b1447-702f-4f88-b0e7-1552e0564dfb
14302024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_6491e072-2069-43dd-9182-395802f8163c
14312024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_500d8529-7595-4c83-9854-2baf5d4b40b4
14322024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_pantry_a56394f5-7075-45b8-8ce9-9ff635ea6a83
14332024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_cc8a4a97-b5aa-4c46-9ccf-c0b7d27518b2
14342024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_116e07d8-bb28-43dc-b2c5-373fb70d2398
14352024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_5ace4d6b-145f-45f4-87f5-a29c3703a710
14362024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_oximeter_4acc4057-9e37-454f-b1dd-7cbe37073be1
14372024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_c21b35d0-f29d-4817-9181-69aea340b2f2
14382024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_external_dns_f5aef115-6099-4bcb-838b-81bfab4449ed
14392024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_external_dns_5b9ebccd-158f-465d-9f58-f826eef0b95b
14402024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_nexus_8f71618e-4655-4b1f-8c0f-30077456ab98
14412024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_nexus_ffb277fe-2a1f-4857-bab5-d5ef3cef77a9
14422024-08-27T19:02:13.082ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_pantry_d726e303-2a8a-466b-a41e-367c1176c197
14432024-08-27T19:02:13.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_pantry_d0a3f70a-f960-4d2e-b6cc-e9add4ddbb74
14442024-08-27T19:02:13.084ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3245 zone = oxz_crucible_347b0d1a-0db7-4863-ad66-da80077239f6
14452024-08-27T19:02:13.099ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14462024-08-27T19:02:13.150ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14472024-08-27T19:02:13.184ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 35528499 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52129 req_id = 33a263c9-d27b-45c5-b934-6158c12dc891 response_code = 204 uri = /omicron-zones
14482024-08-27T19:02:13.215ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1286
14492024-08-27T19:02:13.215ZINFOSledAgent (RSS): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14502024-08-27T19:02:13.215ZINFOSledAgent (RSS): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14512024-08-27T19:02:13.231ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:687
14522024-08-27T19:02:13.245ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:700
14532024-08-27T19:02:13.407ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), local_pref: None, nexthop: 10.151.1.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:867
14542024-08-27T19:02:13.603ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14552024-08-27T19:02:13.714ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14562024-08-27T19:02:13.842ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14572024-08-27T19:02:14.035ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14582024-08-27T19:02:14.248ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14592024-08-27T19:02:14.544ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14602024-08-27T19:02:14.918ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14612024-08-27T19:02:15.165ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14622024-08-27T19:02:15.424ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14632024-08-27T19:02:15.891ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14642024-08-27T19:02:16.485ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14652024-08-27T19:02:16.486ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 39.911458669s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:424 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
14662024-08-27T19:02:17.221ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14672024-08-27T19:02:18.037ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14682024-08-27T19:02:19.366ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14692024-08-27T19:02:20.938ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14702024-08-27T19:02:22.743ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14712024-08-27T19:02:24.150ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14722024-08-27T19:02:26.136ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14732024-08-27T19:02:28.672ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/c74aab71-8e38-4613-a469-5ba1cc230991/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:929
14742024-08-27T19:02:30.693ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "43ce242f-bcbe-4ff1-acc7-e094b02619c9", "content-length": "173", "date": "Tue, 27 Aug 2024 19:02:30 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"c74aab71-8e38-4613-a469-5ba1cc230991\"", request_id: "43ce242f-bcbe-4ff1-acc7-e094b02619c9" } file = sled-agent/src/rack_setup/service.rs:929
14752024-08-27T19:02:35.960ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "5c421d74-5bec-4549-a62d-035c70fc9d5e", "content-length": "173", "date": "Tue, 27 Aug 2024 19:02:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e38b401b-2d22-4589-ac73-fc644b0a15b2\"", request_id: "5c421d74-5bec-4549-a62d-035c70fc9d5e" } file = sled-agent/src/rack_setup/service.rs:929
14762024-08-27T19:02:37.806ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64889
14772024-08-27T19:02:37.806ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64889 req_id = 56458df9-5aa0-4578-92d3-9ba09255a48b response_code = 200 uri = /baseboard
14782024-08-27T19:02:41.611ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6fefd4fb-152f-4deb-a902-04d1067241bf", "content-length": "173", "date": "Tue, 27 Aug 2024 19:02:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e38b401b-2d22-4589-ac73-fc644b0a15b2\"", request_id: "6fefd4fb-152f-4deb-a902-04d1067241bf" } file = sled-agent/src/rack_setup/service.rs:929
14792024-08-27T19:02:45.540ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1a08ad40-2327-450b-9db9-8bb3a1495343", "content-length": "173", "date": "Tue, 27 Aug 2024 19:02:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e38b401b-2d22-4589-ac73-fc644b0a15b2\"", request_id: "1a08ad40-2327-450b-9db9-8bb3a1495343" } file = sled-agent/src/rack_setup/service.rs:929
14802024-08-27T19:02:51.976ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "50ede5e8-3862-4562-8130-9360e60be45f", "content-length": "173", "date": "Tue, 27 Aug 2024 19:02:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e38b401b-2d22-4589-ac73-fc644b0a15b2\"", request_id: "50ede5e8-3862-4562-8130-9360e60be45f" } file = sled-agent/src/rack_setup/service.rs:929
14812024-08-27T19:02:55.172ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:544 new_generation = 1 old_generation = 1 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
14822024-08-27T19:02:55.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53947
14832024-08-27T19:02:55.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14842024-08-27T19:02:55.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94324 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53947 req_id = dabec411-11b1-49b8-8ea7-8e9dad581549 response_code = 200 uri = /inventory
14852024-08-27T19:02:55.401ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
14862024-08-27T19:02:55.401ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/omicron-zones.json file = common/src/ledger.rs:177
14872024-08-27T19:02:55.407ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/omicron-zones.json file = common/src/ledger.rs:177
14882024-08-27T19:02:55.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53947 req_id = 27943b44-ae41-4ae2-820c-4baabc9b427b response_code = 200 uri = /omicron-zones
14892024-08-27T19:02:59.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33215
14902024-08-27T19:02:59.839ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
14912024-08-27T19:02:59.839ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14922024-08-27T19:02:59.840ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14932024-08-27T19:02:59.840ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14942024-08-27T19:02:59.840ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
14952024-08-27T19:02:59.840ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
14962024-08-27T19:02:59.840ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
14972024-08-27T19:02:59.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33215 req_id = d83a2fbf-8551-45f2-8a08-c1508130958d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14982024-08-27T19:02:59.842ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:939
14992024-08-27T19:03:00.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43638
15002024-08-27T19:03:00.070ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
15012024-08-27T19:03:00.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 86311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43638 req_id = a2542bba-a8a8-4c0d-928a-d2f6748559e8 response_code = 200 uri = /inventory
15022024-08-27T19:03:00.157ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
15032024-08-27T19:03:00.157ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/config/omicron-zones.json file = common/src/ledger.rs:177
15042024-08-27T19:03:00.158ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/config/omicron-zones.json file = common/src/ledger.rs:177
15052024-08-27T19:03:00.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1997 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43638 req_id = 214e47d0-97f1-4c84-a7c5-a707feef0fba response_code = 200 uri = /omicron-zones
15062024-08-27T19:03:00.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54778
15072024-08-27T19:03:00.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54778 req_id = 5b5ff8aa-fadd-467d-99d7-f15f4f710ebe response_code = 200 uri = /vpc-routes
15082024-08-27T19:03:00.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2585 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54778 req_id = fee57bc7-ed40-4aac-91e1-32f43edfc5ed response_code = 204 uri = /vpc-routes
15092024-08-27T19:03:00.500ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44716
15102024-08-27T19:03:00.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 619 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44716 req_id = 864a853e-9c93-4caa-977e-1f92bc4122a0 response_code = 200 uri = /v2p
15112024-08-27T19:03:00.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33839
15122024-08-27T19:03:00.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33839 req_id = b04d0531-48f8-4322-98b2-a62c85936f5e response_code = 200 uri = /vpc-routes
15132024-08-27T19:03:00.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33839 req_id = 544c361a-aaa0-458f-a69b-48ce60bd6571 response_code = 204 uri = /vpc-routes
15142024-08-27T19:03:00.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58978
15152024-08-27T19:03:00.705ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15162024-08-27T19:03:00.815ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15172024-08-27T19:03:00.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 179525 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58978 req_id = 2935c611-53df-4dfa-a2ab-ed3e40c078a6 response_code = 204 uri = /switch-ports
15182024-08-27T19:03:00.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43929
15192024-08-27T19:03:00.884ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44428
15202024-08-27T19:03:00.885ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15212024-08-27T19:03:00.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1051 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44428 req_id = e93e3745-4150-4398-93b7-d54ed0b7ffe8 response_code = 200 uri = /v2p
15222024-08-27T19:03:00.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 8590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58978 req_id = 832e9737-440a-4bdb-b80b-5e15a3bb9185 response_code = 200 uri = /network-bootstore-config
15232024-08-27T19:03:00.916ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
15242024-08-27T19:03:00.916ZINFOSledAgent (bootstore): Writing ledger to /pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
15252024-08-27T19:03:00.921ZINFOSledAgent (bootstore): Writing ledger to /pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
15262024-08-27T19:03:00.922ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
15272024-08-27T19:03:00.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7662 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58978 req_id = 12ac5ac2-1ed5-4cc6-9f46-42a7c2df9bf2 response_code = 204 uri = /network-bootstore-config
15282024-08-27T19:03:00.929ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15292024-08-27T19:03:00.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43929 req_id = 7a5f8890-ec5c-4422-8437-bd06ff785554 response_code = 204 uri = /switch-ports
15302024-08-27T19:03:00.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 693 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43929 req_id = 829fe323-eeaf-4889-a368-8ab5179e83c7 response_code = 200 uri = /network-bootstore-config
15312024-08-27T19:03:01.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38023
15322024-08-27T19:03:01.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38023 req_id = 28f276a1-8279-492c-b24d-897b653007f9 response_code = 200 uri = /vpc-routes
15332024-08-27T19:03:01.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38023 req_id = c8fc7d38-c7e4-447d-ad84-b151e5d03ed3 response_code = 204 uri = /vpc-routes
15342024-08-27T19:03:01.514ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42176
15352024-08-27T19:03:01.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42176 req_id = 7b70cca5-aebb-4459-8b05-e0f8175bf547 response_code = 200 uri = /v2p
15362024-08-27T19:03:01.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52586
15372024-08-27T19:03:01.594ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15382024-08-27T19:03:01.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15392024-08-27T19:03:01.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15402024-08-27T19:03:01.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15412024-08-27T19:03:01.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15422024-08-27T19:03:01.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15432024-08-27T19:03:01.594ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
15442024-08-27T19:03:01.594ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52586 req_id = e9513dc0-28d5-416e-bc24-1984c9a2b31b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15452024-08-27T19:03:01.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62200
15462024-08-27T19:03:01.595ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15472024-08-27T19:03:01.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15482024-08-27T19:03:01.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15492024-08-27T19:03:01.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15502024-08-27T19:03:01.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15512024-08-27T19:03:01.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15522024-08-27T19:03:01.595ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
15532024-08-27T19:03:01.595ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62200 req_id = df70a79a-bc87-4539-95d4-62ce926944ab response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15542024-08-27T19:03:01.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42716
15552024-08-27T19:03:01.678ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15562024-08-27T19:03:01.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15572024-08-27T19:03:01.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15582024-08-27T19:03:01.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15592024-08-27T19:03:01.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15602024-08-27T19:03:01.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15612024-08-27T19:03:01.679ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
15622024-08-27T19:03:01.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42716 req_id = 28448634-386c-4ab3-8c2d-c425be6628c7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15632024-08-27T19:03:01.919ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36755
15642024-08-27T19:03:01.919ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15652024-08-27T19:03:01.958ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15662024-08-27T19:03:02.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99183 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36755 req_id = c1322a9d-d7ed-4887-ad60-61d6b20f3943 response_code = 204 uri = /switch-ports
15672024-08-27T19:03:02.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36755 req_id = 5843350a-9ef4-4711-a0d8-7489af87c2e7 response_code = 200 uri = /network-bootstore-config
15682024-08-27T19:03:04.920ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37197
15692024-08-27T19:03:04.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37197 req_id = 2b180eb1-ca63-4868-8efc-f65d31cc5dbb response_code = 200 uri = /vpc-routes
15702024-08-27T19:03:04.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37197 req_id = 3cd538ef-9ee0-49a9-9fe1-02ea139a0842 response_code = 204 uri = /vpc-routes
15712024-08-27T19:03:07.840ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43396
15722024-08-27T19:03:07.840ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43396 req_id = 46d07803-9a48-405c-ad6a-1cd3891ec2fc response_code = 200 uri = /baseboard
15732024-08-27T19:03:26.529ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:55586 remote_addr = [fd00:1122:3344:101::d]:44731 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2
15742024-08-27T19:03:26.578ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 48167 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 6a75bd99-e27a-43c9-8f30-e688ef390c4f response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
15752024-08-27T19:03:30.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53720
15762024-08-27T19:03:30.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53720 req_id = a47aa68f-28f8-4ee2-ac4f-93b7a1414c2c response_code = 200 uri = /vpc-routes
15772024-08-27T19:03:30.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53720 req_id = ddf56089-b265-41bc-b62f-0db0a15b1814 response_code = 204 uri = /vpc-routes
15782024-08-27T19:03:30.493ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64304
15792024-08-27T19:03:30.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64304 req_id = d6823427-383a-4ad8-9984-4f0225a57a37 response_code = 200 uri = /vpc-routes
15802024-08-27T19:03:30.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64304 req_id = 341f7d7e-0ecf-4a8e-a800-08702ec63718 response_code = 204 uri = /vpc-routes
15812024-08-27T19:03:30.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40514
15822024-08-27T19:03:30.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40514 req_id = 2c6a3c7f-3567-4f67-bb5f-1983676ec0e8 response_code = 200 uri = /v2p
15832024-08-27T19:03:30.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39028
15842024-08-27T19:03:30.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39028 req_id = 86f9f47c-8f11-43d8-88dd-83d0eb42bfee response_code = 200 uri = /v2p
15852024-08-27T19:03:30.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40964
15862024-08-27T19:03:30.721ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15872024-08-27T19:03:30.761ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15882024-08-27T19:03:30.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94727 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40964 req_id = fdb57501-ca5f-462a-a14b-377bb9085f06 response_code = 204 uri = /switch-ports
15892024-08-27T19:03:30.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40964 req_id = 0c094ebc-93cf-49aa-8900-51effc772459 response_code = 200 uri = /network-bootstore-config
15902024-08-27T19:03:30.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36390
15912024-08-27T19:03:30.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
15922024-08-27T19:03:30.860ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
15932024-08-27T19:03:30.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90690 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36390 req_id = 2b38f75a-cf78-4218-8f4a-82197a933c97 response_code = 204 uri = /switch-ports
15942024-08-27T19:03:30.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36390 req_id = fea8a205-a18c-4b14-992f-8dc6c0c74cd0 response_code = 200 uri = /network-bootstore-config
15952024-08-27T19:03:31.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49259
15962024-08-27T19:03:31.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49259 req_id = 63dc0901-5bc9-437b-a231-1fa3944890c6 response_code = 200 uri = /vpc-routes
15972024-08-27T19:03:31.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49259 req_id = 3ace5e35-cc60-4bc7-b22a-06b86d35dd4b response_code = 204 uri = /vpc-routes
15982024-08-27T19:03:31.548ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55019
15992024-08-27T19:03:31.548ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55019 req_id = 357eb581-8c3c-4e1a-8762-e93ff0a161a8 response_code = 200 uri = /v2p
16002024-08-27T19:03:31.689ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35199
16012024-08-27T19:03:31.689ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16022024-08-27T19:03:31.726ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16032024-08-27T19:03:31.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35199 req_id = 98faaf23-702b-4b37-83c1-cbb3cfa7663b response_code = 204 uri = /switch-ports
16042024-08-27T19:03:31.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35199 req_id = f2fff147-237f-4a0f-a8f1-1ba7f86afbca response_code = 200 uri = /network-bootstore-config
16052024-08-27T19:03:37.875ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38628
16062024-08-27T19:03:37.875ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 532 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38628 req_id = 99648e91-f3b6-41c8-87af-613859463e27 response_code = 200 uri = /baseboard
16072024-08-27T19:03:56.537ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6800 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 5fada090-223d-4fde-b9f9-9dc405d58e2a response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
16082024-08-27T19:04:00.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41908
16092024-08-27T19:04:00.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41908 req_id = 535691de-e1e9-497f-b9e5-4cdf464a30a6 response_code = 200 uri = /vpc-routes
16102024-08-27T19:04:00.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41908 req_id = d1a5b28d-32ed-4fef-861b-7c8bd47596f5 response_code = 204 uri = /vpc-routes
16112024-08-27T19:04:00.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43355
16122024-08-27T19:04:00.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43355 req_id = dad23694-5836-444d-8eb3-c5238f63e31b response_code = 200 uri = /v2p
16132024-08-27T19:04:00.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58869
16142024-08-27T19:04:00.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 798 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58869 req_id = 003a9ea1-e88b-4d19-a913-f0fd79f9ec8f response_code = 200 uri = /vpc-routes
16152024-08-27T19:04:00.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58869 req_id = 90b70cf4-ec0c-4dab-a24f-6dda90356b42 response_code = 204 uri = /vpc-routes
16162024-08-27T19:04:00.484ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36945
16172024-08-27T19:04:00.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36945 req_id = dfa37974-a964-4aa2-8c08-db9ec2a7723f response_code = 200 uri = /v2p
16182024-08-27T19:04:00.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33111
16192024-08-27T19:04:00.551ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16202024-08-27T19:04:00.590ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16212024-08-27T19:04:00.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96136 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33111 req_id = 6a7facc3-879f-49f9-bf99-b33e43d2f098 response_code = 204 uri = /switch-ports
16222024-08-27T19:04:00.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57687
16232024-08-27T19:04:00.647ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16242024-08-27T19:04:00.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3612 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33111 req_id = 5e29ce54-d14d-467b-a023-fe7e68886af9 response_code = 200 uri = /network-bootstore-config
16252024-08-27T19:04:00.682ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16262024-08-27T19:04:00.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89404 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57687 req_id = 9670aeaf-1577-49d6-88c8-38c3a5fb1de9 response_code = 204 uri = /switch-ports
16272024-08-27T19:04:00.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57687 req_id = 8317b635-4cf5-46d1-818f-9fd869bd84c0 response_code = 200 uri = /network-bootstore-config
16282024-08-27T19:04:01.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49907
16292024-08-27T19:04:01.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49907 req_id = cc5ad31a-feb3-4448-b97b-6c636d64885e response_code = 200 uri = /vpc-routes
16302024-08-27T19:04:01.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49907 req_id = 783f1371-533c-460c-a7c1-ccb376c37551 response_code = 204 uri = /vpc-routes
16312024-08-27T19:04:01.429ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60966
16322024-08-27T19:04:01.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60966 req_id = fdb1dac4-344c-4228-be97-33702060032c response_code = 200 uri = /v2p
16332024-08-27T19:04:01.552ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45554
16342024-08-27T19:04:01.552ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16352024-08-27T19:04:01.597ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16362024-08-27T19:04:01.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45554 req_id = 10644fab-83f0-4f77-9bae-d0c1b016efd4 response_code = 204 uri = /switch-ports
16372024-08-27T19:04:01.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45554 req_id = 8c7ff427-8846-4c70-a48e-78ea323aa6ee response_code = 200 uri = /network-bootstore-config
16382024-08-27T19:04:07.926ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49659
16392024-08-27T19:04:07.926ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49659 req_id = 14aa3e3a-7d2f-4f0e-a4d6-f5c977f08782 response_code = 200 uri = /baseboard
16402024-08-27T19:04:26.551ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6880 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 47754713-d53c-4211-b6a9-f86c74bfe039 response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
16412024-08-27T19:04:29.317ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
16422024-08-27T19:04:30.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42445
16432024-08-27T19:04:30.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42445 req_id = e69c8375-038c-4a96-8625-4ab956750755 response_code = 200 uri = /v2p
16442024-08-27T19:04:30.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41749
16452024-08-27T19:04:30.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41749 req_id = bd85c40a-ab34-48eb-bd34-2fb7ce52c7a2 response_code = 200 uri = /v2p
16462024-08-27T19:04:30.570ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47856
16472024-08-27T19:04:30.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47856 req_id = 92b6f88d-ba8b-4f8c-a76a-cbd670a39677 response_code = 200 uri = /vpc-routes
16482024-08-27T19:04:30.579ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 971 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47856 req_id = 7158ee5e-6eba-49a4-ad1b-613a7df9a4ea response_code = 204 uri = /vpc-routes
16492024-08-27T19:04:30.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43586
16502024-08-27T19:04:30.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43586 req_id = 99a6dc5e-8588-4539-880e-4309cac53538 response_code = 200 uri = /vpc-routes
16512024-08-27T19:04:30.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43586 req_id = 57cd07ec-dff3-4857-b8b4-f366ed9cad26 response_code = 204 uri = /vpc-routes
16522024-08-27T19:04:30.681ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50675
16532024-08-27T19:04:30.681ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16542024-08-27T19:04:30.720ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16552024-08-27T19:04:30.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96821 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50675 req_id = 6ec320ef-728f-47ef-817d-405b6d476567 response_code = 204 uri = /switch-ports
16562024-08-27T19:04:30.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59855
16572024-08-27T19:04:30.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50675 req_id = a441f8fb-250c-4c4a-b3d2-44ff841f280e response_code = 200 uri = /network-bootstore-config
16582024-08-27T19:04:30.779ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16592024-08-27T19:04:30.816ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16602024-08-27T19:04:30.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92617 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59855 req_id = e43a2b7b-06d9-4a4a-9bae-95944e627f57 response_code = 204 uri = /switch-ports
16612024-08-27T19:04:30.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59855 req_id = e11ecdb4-3d7e-4bec-a6f3-1723b67a28b4 response_code = 200 uri = /network-bootstore-config
16622024-08-27T19:04:31.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56130
16632024-08-27T19:04:31.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56130 req_id = a5089ec2-1d40-4a95-883b-0364cc88a754 response_code = 200 uri = /vpc-routes
16642024-08-27T19:04:31.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56130 req_id = d20da329-0dc4-4688-8c9f-4fef8df1f0be response_code = 204 uri = /vpc-routes
16652024-08-27T19:04:31.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35704
16662024-08-27T19:04:31.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 934 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35704 req_id = 73159c63-8794-4f3f-8ee1-229b9263d99e response_code = 200 uri = /v2p
16672024-08-27T19:04:31.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62017
16682024-08-27T19:04:31.677ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16692024-08-27T19:04:31.716ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16702024-08-27T19:04:31.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98535 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62017 req_id = 241a5d20-8611-41b6-b3c8-c705162a021b response_code = 204 uri = /switch-ports
16712024-08-27T19:04:31.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 683 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62017 req_id = 3154929e-371e-4e24-8e70-2a27333eb2b5 response_code = 200 uri = /network-bootstore-config
16722024-08-27T19:04:37.981ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34835
16732024-08-27T19:04:37.981ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 101 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34835 req_id = 9746f3fe-8af7-44bf-9b1a-bdc5a266b52c response_code = 200 uri = /baseboard
16742024-08-27T19:04:56.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7403 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 81992a70-88b3-44f3-be13-493a5fa1832e response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
16752024-08-27T19:05:00.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35493
16762024-08-27T19:05:00.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 733 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35493 req_id = e7ae2157-8baf-4ee9-83f5-a3c511aeef92 response_code = 200 uri = /vpc-routes
16772024-08-27T19:05:00.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35493 req_id = f859d742-08b0-41e8-85c7-9d5329ddd3a8 response_code = 204 uri = /vpc-routes
16782024-08-27T19:05:00.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33986
16792024-08-27T19:05:00.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1049 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33986 req_id = dbea8bab-19c3-4d7b-8ef2-9c507373c399 response_code = 200 uri = /v2p
16802024-08-27T19:05:00.488ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41581
16812024-08-27T19:05:00.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 641 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41581 req_id = de6b439b-80fd-482c-8f85-69dda21a6b82 response_code = 200 uri = /vpc-routes
16822024-08-27T19:05:00.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41581 req_id = a238a929-c739-4ca5-9287-a5cb3c3f7be2 response_code = 204 uri = /vpc-routes
16832024-08-27T19:05:00.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43767
16842024-08-27T19:05:00.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43767 req_id = 776f20d2-837d-4c8f-8eee-7dcb7cf5e230 response_code = 200 uri = /v2p
16852024-08-27T19:05:00.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62916
16862024-08-27T19:05:00.565ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16872024-08-27T19:05:00.603ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16882024-08-27T19:05:00.664ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99176 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62916 req_id = d2f3b98c-cb3d-43ab-a32b-1ddce4a8cd35 response_code = 204 uri = /switch-ports
16892024-08-27T19:05:00.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61903
16902024-08-27T19:05:00.664ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
16912024-08-27T19:05:00.699ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
16922024-08-27T19:05:00.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90290 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61903 req_id = 708596d3-66b2-4471-b45a-92d9f5d42ce1 response_code = 204 uri = /switch-ports
16932024-08-27T19:05:00.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 810 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62916 req_id = ec457098-ec1a-46d8-8512-0e8810da91f7 response_code = 200 uri = /network-bootstore-config
16942024-08-27T19:05:00.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61903 req_id = 2e7cdf33-d5c1-425e-b93b-4ad98ef1a389 response_code = 200 uri = /network-bootstore-config
16952024-08-27T19:05:01.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37229
16962024-08-27T19:05:01.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37229 req_id = 8b0efa8b-8cbc-4f6f-8259-50e0e87348fa response_code = 200 uri = /vpc-routes
16972024-08-27T19:05:01.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37229 req_id = 32ef9d54-8105-4814-92e5-3c4869611a40 response_code = 204 uri = /vpc-routes
16982024-08-27T19:05:01.415ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60628
16992024-08-27T19:05:01.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60628 req_id = 1461981b-3f3c-49b5-b589-948312d78661 response_code = 200 uri = /v2p
17002024-08-27T19:05:01.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55749
17012024-08-27T19:05:01.543ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17022024-08-27T19:05:01.582ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17032024-08-27T19:05:01.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97966 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55749 req_id = 8eb9461c-f907-476d-80a6-a1a9580deb9a response_code = 204 uri = /switch-ports
17042024-08-27T19:05:01.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55749 req_id = db6a8807-4a90-4d2c-8fea-ed7c48bd90a3 response_code = 200 uri = /network-bootstore-config
17052024-08-27T19:05:08.018ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52798
17062024-08-27T19:05:08.018ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 79 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52798 req_id = f08fec22-b1b6-4c48-a689-e0b5fe8d4fad response_code = 200 uri = /baseboard
17072024-08-27T19:05:26.573ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6272 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 1e40bb89-8872-4898-935b-3ff0da172143 response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
17082024-08-27T19:05:30.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62150
17092024-08-27T19:05:30.510ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 695 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62150 req_id = 897579c4-9fb0-4d8f-8a81-0372ee06ecdc response_code = 200 uri = /v2p
17102024-08-27T19:05:30.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35499
17112024-08-27T19:05:30.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35499 req_id = 81ae42e3-144c-4873-9733-477de3d2ff96 response_code = 200 uri = /v2p
17122024-08-27T19:05:30.520ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49310
17132024-08-27T19:05:30.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 834 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49310 req_id = eff3dd2c-5f89-4d42-a9c0-9bb04fedf219 response_code = 200 uri = /vpc-routes
17142024-08-27T19:05:30.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49310 req_id = a13964b1-9231-41ab-b57f-b2e1f5bd1519 response_code = 204 uri = /vpc-routes
17152024-08-27T19:05:30.640ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36407
17162024-08-27T19:05:30.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36407 req_id = fa354106-9121-462a-85a5-12fefb509397 response_code = 200 uri = /vpc-routes
17172024-08-27T19:05:30.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36407 req_id = aa787b64-8409-43e0-8b51-e831c1aea3af response_code = 204 uri = /vpc-routes
17182024-08-27T19:05:30.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41696
17192024-08-27T19:05:30.770ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17202024-08-27T19:05:30.811ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17212024-08-27T19:05:30.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100906 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41696 req_id = f1f77e80-73e7-4b27-be07-db1ad55b5c70 response_code = 204 uri = /switch-ports
17222024-08-27T19:05:30.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62125
17232024-08-27T19:05:30.871ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17242024-08-27T19:05:30.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3366 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41696 req_id = d33bcdf8-5c65-48f6-bfa8-8e7d38ccb3d0 response_code = 200 uri = /network-bootstore-config
17252024-08-27T19:05:30.907ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17262024-08-27T19:05:30.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 89539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62125 req_id = 3f2d549d-8f92-4502-9c90-9090ebefcc45 response_code = 204 uri = /switch-ports
17272024-08-27T19:05:30.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 653 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62125 req_id = b8e03fc9-7a44-49a3-af0a-f54827752589 response_code = 200 uri = /network-bootstore-config
17282024-08-27T19:05:31.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63360
17292024-08-27T19:05:31.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63360 req_id = 3d2656c5-f130-46b6-b320-f5c53dec4d36 response_code = 200 uri = /vpc-routes
17302024-08-27T19:05:31.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63360 req_id = 8c0f368a-4ded-4d19-8801-0651bdf67354 response_code = 204 uri = /vpc-routes
17312024-08-27T19:05:31.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33926
17322024-08-27T19:05:31.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 646 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33926 req_id = 56a54061-e526-444b-a850-f4482c8b41d1 response_code = 200 uri = /v2p
17332024-08-27T19:05:31.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49706
17342024-08-27T19:05:31.932ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17352024-08-27T19:05:31.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17362024-08-27T19:05:32.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 105822 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49706 req_id = 38945c81-7efb-4d71-88a9-021f9c884ee6 response_code = 204 uri = /switch-ports
17372024-08-27T19:05:32.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49706 req_id = 53bef764-33d1-45e8-8e30-ef9df8432d40 response_code = 200 uri = /network-bootstore-config
17382024-08-27T19:05:38.055ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37020
17392024-08-27T19:05:38.055ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 88 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37020 req_id = 3923ae72-b2e7-48f0-82f4-c787c5d07d79 response_code = 200 uri = /baseboard
17402024-08-27T19:05:56.614ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7145 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 799d950e-d20b-45e4-8ce5-57ff2c2127cb response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
17412024-08-27T19:06:00.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35929
17422024-08-27T19:06:00.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35929 req_id = d83a324e-6d9f-4e71-967d-ace93890045b response_code = 200 uri = /vpc-routes
17432024-08-27T19:06:00.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58712
17442024-08-27T19:06:00.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58712 req_id = 51ae5640-3ed1-4552-95fb-bf4c081daff4 response_code = 200 uri = /vpc-routes
17452024-08-27T19:06:00.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35929 req_id = 57b6aef5-d63d-457d-93ea-d1f3c23dc282 response_code = 204 uri = /vpc-routes
17462024-08-27T19:06:00.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58712 req_id = e43dcfc1-1edd-421c-84b8-2eeca38aa260 response_code = 204 uri = /vpc-routes
17472024-08-27T19:06:00.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52447
17482024-08-27T19:06:00.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52447 req_id = fa0ba0e6-5d13-4ead-9155-00b0a6760c9f response_code = 200 uri = /v2p
17492024-08-27T19:06:00.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51938
17502024-08-27T19:06:00.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51938 req_id = 833b1949-530e-4e72-ab86-9f022af8bb8a response_code = 200 uri = /v2p
17512024-08-27T19:06:00.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56112
17522024-08-27T19:06:00.596ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17532024-08-27T19:06:00.637ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17542024-08-27T19:06:00.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97006 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56112 req_id = 0330163a-b5e8-41e0-8e62-590e649c1132 response_code = 204 uri = /switch-ports
17552024-08-27T19:06:00.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38899
17562024-08-27T19:06:00.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56112 req_id = 6a7883ce-a6c1-42df-93d9-3e1f6fcab07f response_code = 200 uri = /network-bootstore-config
17572024-08-27T19:06:00.694ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17582024-08-27T19:06:00.728ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17592024-08-27T19:06:00.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38899 req_id = 610de9e1-0095-4566-85b7-5d1845ef48d5 response_code = 204 uri = /switch-ports
17602024-08-27T19:06:00.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38899 req_id = ba3924b4-b582-49a0-8f44-ec8a0b9bc238 response_code = 200 uri = /network-bootstore-config
17612024-08-27T19:06:01.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44572
17622024-08-27T19:06:01.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 873 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44572 req_id = 1d0c72b5-bbfc-445a-aaab-234a90ea4f52 response_code = 200 uri = /vpc-routes
17632024-08-27T19:06:01.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44572 req_id = 836a3bdb-a65b-4502-80a3-42011456eca0 response_code = 204 uri = /vpc-routes
17642024-08-27T19:06:01.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57210
17652024-08-27T19:06:01.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57210 req_id = 81d20c5d-7bf8-4ce1-9852-b3977cac475f response_code = 200 uri = /v2p
17662024-08-27T19:06:01.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54695
17672024-08-27T19:06:01.633ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17682024-08-27T19:06:01.674ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17692024-08-27T19:06:01.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99856 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54695 req_id = 3f0788b3-1057-4d73-b89d-50dd2a16c9de response_code = 204 uri = /switch-ports
17702024-08-27T19:06:01.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 714 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54695 req_id = 69714c3b-bf31-4faf-a89f-764eab888470 response_code = 200 uri = /network-bootstore-config
17712024-08-27T19:06:08.079ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34987
17722024-08-27T19:06:08.079ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:34987 req_id = 40fe42d8-7f85-4fd1-8804-1ae77d33a185 response_code = 200 uri = /baseboard
17732024-08-27T19:06:26.599ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7156 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 269a02c0-1821-4f73-b685-8a089f2b33b2 response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
17742024-08-27T19:06:30.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63038
17752024-08-27T19:06:30.470ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63038 req_id = ab310110-a7da-4c07-be94-09682dc08856 response_code = 200 uri = /vpc-routes
17762024-08-27T19:06:30.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63038 req_id = 927db270-94a3-467c-abdc-fecd35b4ad33 response_code = 204 uri = /vpc-routes
17772024-08-27T19:06:30.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49796
17782024-08-27T19:06:30.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49796 req_id = bcdeba54-389f-4791-9d4e-bbae5eda4352 response_code = 200 uri = /v2p
17792024-08-27T19:06:30.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57480
17802024-08-27T19:06:30.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57480 req_id = cf521e3c-cebe-46a1-839c-ec2f16538eb4 response_code = 200 uri = /vpc-routes
17812024-08-27T19:06:30.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57480 req_id = 2f5b332a-ce3a-43a6-94e2-4d9e72ca0da3 response_code = 204 uri = /vpc-routes
17822024-08-27T19:06:30.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32798
17832024-08-27T19:06:30.616ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32798 req_id = ffde4373-7c07-4216-b11b-9469d563df0c response_code = 200 uri = /v2p
17842024-08-27T19:06:30.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38707
17852024-08-27T19:06:30.834ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17862024-08-27T19:06:30.873ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17872024-08-27T19:06:30.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92621 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38707 req_id = 3fe7767a-4f71-48f6-b018-822c1b1e9a4c response_code = 204 uri = /switch-ports
17882024-08-27T19:06:30.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62844
17892024-08-27T19:06:30.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38707 req_id = 05e28227-f3cc-4ce3-8373-7bc5e1c7a682 response_code = 200 uri = /network-bootstore-config
17902024-08-27T19:06:30.931ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
17912024-08-27T19:06:30.966ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
17922024-08-27T19:06:31.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 87611 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62844 req_id = 8bcbf895-b774-45e7-802b-e8cdcf6ddb78 response_code = 204 uri = /switch-ports
17932024-08-27T19:06:31.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62844 req_id = 2821684c-6625-445a-aa06-bff613b18337 response_code = 200 uri = /network-bootstore-config
17942024-08-27T19:06:31.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43181
17952024-08-27T19:06:31.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43181 req_id = fca628a1-c646-400c-847c-6e908b018c07 response_code = 200 uri = /v2p
17962024-08-27T19:06:31.619ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37645
17972024-08-27T19:06:31.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37645 req_id = f9269557-23b2-4052-96fc-d8c1a6766291 response_code = 200 uri = /vpc-routes
17982024-08-27T19:06:31.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37645 req_id = 00bad8ca-5f5c-432a-a3a2-cd69cb6ea010 response_code = 204 uri = /vpc-routes
17992024-08-27T19:06:31.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63913
18002024-08-27T19:06:31.821ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18012024-08-27T19:06:31.855ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18022024-08-27T19:06:31.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92354 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63913 req_id = e170bc2c-8dae-419b-b418-04ea44c1fc4d response_code = 204 uri = /switch-ports
18032024-08-27T19:06:31.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63913 req_id = fe7bf416-4cfa-4f66-9700-9ae6ff3d1b0e response_code = 200 uri = /network-bootstore-config
18042024-08-27T19:06:38.112ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64811
18052024-08-27T19:06:38.112ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 645 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64811 req_id = d51b26d5-f23b-41e1-a0ee-4bf9242f99b2 response_code = 200 uri = /baseboard
18062024-08-27T19:06:56.598ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7127 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = a9d3f360-dfd5-4e54-a7e3-86e1611dca71 response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
18072024-08-27T19:07:00.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48659
18082024-08-27T19:07:00.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48659 req_id = d0c7e669-0a69-4a6b-8bff-c84e17861e5f response_code = 200 uri = /vpc-routes
18092024-08-27T19:07:00.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59465
18102024-08-27T19:07:00.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 834 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59465 req_id = 7d017a1a-13c3-4712-bbbe-7d057d8b0f23 response_code = 200 uri = /v2p
18112024-08-27T19:07:00.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48659 req_id = b8829135-8c5d-4653-a470-2dcf99aaa079 response_code = 204 uri = /vpc-routes
18122024-08-27T19:07:00.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34949
18132024-08-27T19:07:00.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 18 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34949 req_id = fe7e7c2e-6812-45a2-ba90-bc8fa2271c4e response_code = 200 uri = /vpc-routes
18142024-08-27T19:07:00.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34949 req_id = faea3c82-2936-4df6-95b9-8c21bd715a9f response_code = 204 uri = /vpc-routes
18152024-08-27T19:07:00.462ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44111
18162024-08-27T19:07:00.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44111 req_id = 9f0a1027-2ccc-46e1-aab4-0a4e82690f91 response_code = 200 uri = /v2p
18172024-08-27T19:07:00.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53113
18182024-08-27T19:07:00.530ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18192024-08-27T19:07:00.572ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18202024-08-27T19:07:00.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100467 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53113 req_id = 402c1ed8-a683-453b-b3ac-9969f79f31e9 response_code = 204 uri = /switch-ports
18212024-08-27T19:07:00.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33867
18222024-08-27T19:07:00.631ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18232024-08-27T19:07:00.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4632 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53113 req_id = aeb5eb00-ae77-4f42-9c3a-81e0276cc215 response_code = 200 uri = /network-bootstore-config
18242024-08-27T19:07:00.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18252024-08-27T19:07:00.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 90590 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33867 req_id = 9050516b-c72e-48c4-859d-8eb57f90635a response_code = 204 uri = /switch-ports
18262024-08-27T19:07:00.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 819 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33867 req_id = 886e912b-8c54-4a12-be4e-44d7cb549c0f response_code = 200 uri = /network-bootstore-config
18272024-08-27T19:07:01.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56600
18282024-08-27T19:07:01.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56600 req_id = 2df03f9e-7c80-4b77-a93c-32c39174e91e response_code = 200 uri = /vpc-routes
18292024-08-27T19:07:01.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56600 req_id = 940f6973-eb57-4578-843e-0d7ed10d3bc1 response_code = 204 uri = /vpc-routes
18302024-08-27T19:07:01.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49409
18312024-08-27T19:07:01.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49409 req_id = 2782df57-403b-4952-a3d2-f5e84945de89 response_code = 200 uri = /v2p
18322024-08-27T19:07:01.501ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53912
18332024-08-27T19:07:01.501ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18342024-08-27T19:07:01.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18352024-08-27T19:07:01.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 100948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53912 req_id = 71869676-4c95-40e2-afa0-3acd426473d8 response_code = 204 uri = /switch-ports
18362024-08-27T19:07:01.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53912 req_id = 24462629-0dce-4d23-ac91-0edfe35ca5e3 response_code = 200 uri = /network-bootstore-config
18372024-08-27T19:07:08.141ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53701
18382024-08-27T19:07:08.141ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 58 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53701 req_id = 5546161b-7564-49e0-9ce1-42b1d6fbb6da response_code = 200 uri = /baseboard
18392024-08-27T19:07:26.593ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6688 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 846bbca2-7433-4d9e-a16d-9840e5bcadd6 response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
18402024-08-27T19:07:30.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54043
18412024-08-27T19:07:30.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54043 req_id = f09fa51e-3b73-4b06-93a9-51df939f4649 response_code = 200 uri = /v2p
18422024-08-27T19:07:30.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61636
18432024-08-27T19:07:30.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61636 req_id = dc4b8f3d-bc23-4ff2-aa67-e9dc2f8e9015 response_code = 200 uri = /vpc-routes
18442024-08-27T19:07:30.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61636 req_id = e4cd5640-6485-49e6-ad6e-0f16909e9ae4 response_code = 204 uri = /vpc-routes
18452024-08-27T19:07:30.611ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58301
18462024-08-27T19:07:30.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58301 req_id = 0121330f-56ac-4c81-b915-5e2fe7fabc0e response_code = 200 uri = /vpc-routes
18472024-08-27T19:07:30.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58301 req_id = ac896234-ec02-4d3c-a5a0-a619f5c27763 response_code = 204 uri = /vpc-routes
18482024-08-27T19:07:30.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54861
18492024-08-27T19:07:30.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54861 req_id = 8dc77af8-b9fe-4330-b17f-20692691a6df response_code = 200 uri = /v2p
18502024-08-27T19:07:30.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64257
18512024-08-27T19:07:30.680ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18522024-08-27T19:07:30.680ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18532024-08-27T19:07:30.680ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18542024-08-27T19:07:30.680ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18552024-08-27T19:07:30.680ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18562024-08-27T19:07:30.680ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18572024-08-27T19:07:30.680ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
18582024-08-27T19:07:30.680ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1064 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64257 req_id = f9d2a8f2-da9d-4868-b359-88b4d33cb1ec response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18592024-08-27T19:07:30.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50115
18602024-08-27T19:07:30.774ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18612024-08-27T19:07:30.813ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18622024-08-27T19:07:30.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96636 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50115 req_id = 43987686-2013-4613-a5d1-bd338dbfc6bd response_code = 204 uri = /switch-ports
18632024-08-27T19:07:30.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59795
18642024-08-27T19:07:30.871ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18652024-08-27T19:07:30.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18662024-08-27T19:07:30.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18672024-08-27T19:07:30.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18682024-08-27T19:07:30.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18692024-08-27T19:07:30.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18702024-08-27T19:07:30.871ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
18712024-08-27T19:07:30.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 480 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59795 req_id = ca5844c8-9472-42c7-8efb-edf753ff4165 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18722024-08-27T19:07:30.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 843 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50115 req_id = 80fddb07-f781-4e66-9af3-7fb597447031 response_code = 200 uri = /network-bootstore-config
18732024-08-27T19:07:30.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56465
18742024-08-27T19:07:30.990ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18752024-08-27T19:07:31.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18762024-08-27T19:07:31.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 96959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56465 req_id = b8b54f12-58e0-4add-b4d7-6e7efabe56bf response_code = 204 uri = /switch-ports
18772024-08-27T19:07:31.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56465 req_id = d6570123-0991-446f-8423-0dda004bb694 response_code = 200 uri = /network-bootstore-config
18782024-08-27T19:07:31.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40157
18792024-08-27T19:07:31.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40157 req_id = 5ff0c275-6c93-48d7-be4c-673c7a7ad7e2 response_code = 200 uri = /vpc-routes
18802024-08-27T19:07:31.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40157 req_id = 9f3d5bb7-a123-4246-ad5e-dd7ed22108d8 response_code = 204 uri = /vpc-routes
18812024-08-27T19:07:31.524ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40872
18822024-08-27T19:07:31.524ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40872 req_id = 9de9889d-beb0-41b0-b23d-54bfbc477824 response_code = 200 uri = /v2p
18832024-08-27T19:07:31.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54644
18842024-08-27T19:07:31.697ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:671 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 004e05a5-9496-4db0-b3fc-3227f05f08a8, kind: Service { id: 5b9ebccd-158f-465d-9f58-f826eef0b95b }, name: Name("external-dns-5b9ebccd-158f-465d-9f58-f826eef0b95b"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 53])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbcf2333-21b9-400a-aaf8-b500b24f6637, kind: Service { id: f5aef115-6099-4bcb-838b-81bfab4449ed }, name: Name("external-dns-f5aef115-6099-4bcb-838b-81bfab4449ed"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 90])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4fb0a1ba-eb76-43c3-a126-7d3b2abac4d2, kind: Service { id: ffb277fe-2a1f-4857-bab5-d5ef3cef77a9 }, name: Name("nexus-ffb277fe-2a1f-4857-bab5-d5ef3cef77a9"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 202, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5be5e57a-aecb-45a9-b752-d688170a4a31, kind: Service { id: 8f71618e-4655-4b1f-8c0f-30077456ab98 }, name: Name("nexus-8f71618e-4655-4b1f-8c0f-30077456ab98"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 211, 52])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 61171934-6bc5-4564-a331-87aed555f916, kind: Service { id: 3c5b8b32-bf96-417e-9684-a3bde590c61f }, name: Name("nexus-3c5b8b32-bf96-417e-9684-a3bde590c61f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 220, 196])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18852024-08-27T19:07:31.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18862024-08-27T19:07:31.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18872024-08-27T19:07:31.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18882024-08-27T19:07:31.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18892024-08-27T19:07:31.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18902024-08-27T19:07:31.697ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:690 port = "opte0" rules = []
18912024-08-27T19:07:31.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54644 req_id = 2b2cc4ba-be7f-41af-b340-0b14d6449be9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18922024-08-27T19:07:31.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50418
18932024-08-27T19:07:31.789ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
18942024-08-27T19:07:31.827ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
18952024-08-27T19:07:31.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95358 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50418 req_id = a41a619e-2aa2-424e-9f9c-b434952a63e6 response_code = 204 uri = /switch-ports
18962024-08-27T19:07:31.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 767 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50418 req_id = dcef067b-ff81-4be5-bdfb-1330dec673a2 response_code = 200 uri = /network-bootstore-config
18972024-08-27T19:07:38.173ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54652
18982024-08-27T19:07:38.173ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 656 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54652 req_id = 42cc9545-5567-4461-85f4-bc6d4bbc3ff4 response_code = 200 uri = /baseboard
18992024-08-27T19:07:56.587ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6057 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 9f2b1328-234d-4f2f-bcc3-4b5567cb811a response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
19002024-08-27T19:08:00.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34199
19012024-08-27T19:08:00.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34199 req_id = 2ee938fb-2a33-4695-a58d-bd3609343e69 response_code = 200 uri = /vpc-routes
19022024-08-27T19:08:00.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34199 req_id = 4fcadf43-f87e-4f95-9482-ac7ccdbe3144 response_code = 204 uri = /vpc-routes
19032024-08-27T19:08:00.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49023
19042024-08-27T19:08:00.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49023 req_id = ff633b04-e734-475a-bc77-beee864b3a61 response_code = 200 uri = /vpc-routes
19052024-08-27T19:08:00.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49023 req_id = 1759199e-afa2-4aa3-a54f-f76db39acd66 response_code = 204 uri = /vpc-routes
19062024-08-27T19:08:00.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63534
19072024-08-27T19:08:00.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63534 req_id = 3618a694-08ed-46a5-b4a2-b46067c6fb61 response_code = 200 uri = /v2p
19082024-08-27T19:08:00.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37766
19092024-08-27T19:08:00.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37766 req_id = 317e582e-4564-499f-b84b-2fb1c85114e1 response_code = 200 uri = /v2p
19102024-08-27T19:08:00.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54048
19112024-08-27T19:08:00.528ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19122024-08-27T19:08:00.568ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19132024-08-27T19:08:00.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 97593 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54048 req_id = 94831994-2afb-4fcd-afdd-2341ac4756ca response_code = 204 uri = /switch-ports
19142024-08-27T19:08:00.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52300
19152024-08-27T19:08:00.625ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19162024-08-27T19:08:00.658ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19172024-08-27T19:08:00.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 85098 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52300 req_id = 437817cc-f0b8-4523-9674-83ee423d2958 response_code = 204 uri = /switch-ports
19182024-08-27T19:08:00.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52300 req_id = 84d71583-bae5-4fc2-90fd-2a2ebc950fd0 response_code = 200 uri = /network-bootstore-config
19192024-08-27T19:08:00.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54048 req_id = b239e990-578b-4194-b4f3-b1a26b8874bd response_code = 200 uri = /network-bootstore-config
19202024-08-27T19:08:01.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46286
19212024-08-27T19:08:01.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46286 req_id = b2c38738-0743-45b3-bd79-435877382ba0 response_code = 200 uri = /vpc-routes
19222024-08-27T19:08:01.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46286 req_id = 71ca78aa-f7dd-461a-bd9b-c241cd699ea6 response_code = 204 uri = /vpc-routes
19232024-08-27T19:08:01.406ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60135
19242024-08-27T19:08:01.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 778 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60135 req_id = 686d3aff-3bb3-4521-9e1d-e6c081852db3 response_code = 200 uri = /v2p
19252024-08-27T19:08:01.630ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48963
19262024-08-27T19:08:01.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19272024-08-27T19:08:01.665ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19282024-08-27T19:08:01.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92085 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48963 req_id = f766d74a-56e2-4e3c-81fc-ddc12345f020 response_code = 204 uri = /switch-ports
19292024-08-27T19:08:01.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48963 req_id = 8acfa59e-7c30-4ab0-ae3e-5344dc5187db response_code = 200 uri = /network-bootstore-config
19302024-08-27T19:08:08.201ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38257
19312024-08-27T19:08:08.201ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38257 req_id = af547966-e13a-4d03-9255-56e6c6915133 response_code = 200 uri = /baseboard
19322024-08-27T19:08:26.670ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7905 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = dbb5d310-f9e7-402e-bdd0-e54e93c0d00d response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
19332024-08-27T19:08:30.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51731
19342024-08-27T19:08:30.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 868 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51731 req_id = 5dd80583-77f8-4686-a6ac-4d800446fd28 response_code = 200 uri = /vpc-routes
19352024-08-27T19:08:30.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51731 req_id = 887fcf97-4693-43ad-9066-c9ef965db61f response_code = 204 uri = /vpc-routes
19362024-08-27T19:08:30.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39016
19372024-08-27T19:08:30.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39016 req_id = 44edb9e1-518f-4fe8-a466-d2681fdabf08 response_code = 200 uri = /v2p
19382024-08-27T19:08:30.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62694
19392024-08-27T19:08:30.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 816 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62694 req_id = 06914a4e-27d4-45d5-9cf5-92c8ba44a02d response_code = 200 uri = /v2p
19402024-08-27T19:08:30.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43421
19412024-08-27T19:08:30.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43421 req_id = f9726a7f-4389-462e-a5bf-65e9d8cc122b response_code = 200 uri = /vpc-routes
19422024-08-27T19:08:30.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43421 req_id = f7484844-3d8a-47a6-b26d-2e363d64ef2b response_code = 204 uri = /vpc-routes
19432024-08-27T19:08:30.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59350
19442024-08-27T19:08:30.719ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19452024-08-27T19:08:30.755ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19462024-08-27T19:08:30.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 88448 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59350 req_id = 0cc6e67f-cedb-464a-b54b-142d99d57879 response_code = 204 uri = /switch-ports
19472024-08-27T19:08:30.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44853
19482024-08-27T19:08:30.808ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19492024-08-27T19:08:30.812ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4299 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59350 req_id = 543d3a9a-c2e6-4623-b46c-961732366d3f response_code = 200 uri = /network-bootstore-config
19502024-08-27T19:08:30.844ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19512024-08-27T19:08:30.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 95686 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44853 req_id = 83dd6f3e-aab2-4def-8ca3-fdb78cb3f6b3 response_code = 204 uri = /switch-ports
19522024-08-27T19:08:30.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44853 req_id = ba314677-531b-4c54-8616-2ab5363f565a response_code = 200 uri = /network-bootstore-config
19532024-08-27T19:08:31.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45213
19542024-08-27T19:08:31.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45213 req_id = 8ec5542e-828d-4c71-ad00-d7e0a340f42a response_code = 200 uri = /vpc-routes
19552024-08-27T19:08:31.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45213 req_id = 4a82bfb8-9dfd-4b0f-9a5d-b43e07f741ac response_code = 204 uri = /vpc-routes
19562024-08-27T19:08:31.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45569
19572024-08-27T19:08:31.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45569 req_id = 3b4f0c60-a8ed-47bd-902a-3059c6a08025 response_code = 200 uri = /v2p
19582024-08-27T19:08:31.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49594
19592024-08-27T19:08:31.848ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
19602024-08-27T19:08:31.886ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
19612024-08-27T19:08:31.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93232 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49594 req_id = 8adba187-8cf3-4379-8dc5-6e3982199249 response_code = 204 uri = /switch-ports
19622024-08-27T19:08:31.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49594 req_id = 25296c9d-72a0-4d9c-9d47-2e168ee4d379 response_code = 200 uri = /network-bootstore-config
19632024-08-27T19:08:38.237ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45642
19642024-08-27T19:08:38.237ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 103 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45642 req_id = 6b4f3c04-6ab0-49b6-99e0-a0279c3879fc response_code = 200 uri = /baseboard
19652024-08-27T19:08:56.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65045
19662024-08-27T19:08:56.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 752 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65045 req_id = 84b77291-068e-4b76-952b-4c8653b525a2 response_code = 200 uri = /v2p
19672024-08-27T19:08:56.642ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:778 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(5493020) }
19682024-08-27T19:08:56.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65045 req_id = cf89c1b0-daf1-42ff-8fc5-de6bd04f4e88 response_code = 204 uri = /v2p
19692024-08-27T19:08:56.668ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7577 local_addr = [fd00:1122:3344:101::1]:55586 method = GET remote_addr = [fd00:1122:3344:101::d]:44731 req_id = 3cf7056d-3067-4b38-9f36-02070050977c response_code = 200 sled_id = e38b401b-2d22-4589-ac73-fc644b0a15b2 uri = /e38b401b-2d22-4589-ac73-fc644b0a15b2
19702024-08-27T19:08:56.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51908
19712024-08-27T19:08:56.782ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:570 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 3141ecdf-594e-4e44-b7f0-f13984811679, kind: Instance { id: ea15c85b-55e9-4411-b55c-111d2f3169a1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5493020), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3141ecdf-594e-4e44-b7f0-f13984811679, kind: Instance { id: ea15c85b-55e9-4411-b55c-111d2f3169a1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5493020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3141ecdf-594e-4e44-b7f0-f13984811679, kind: Instance { id: ea15c85b-55e9-4411-b55c-111d2f3169a1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5493020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5493020))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3141ecdf-594e-4e44-b7f0-f13984811679, kind: Instance { id: ea15c85b-55e9-4411-b55c-111d2f3169a1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5493020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-5731b2ab747", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5ae4c937-80e8-4651-b9f8-fda80aae47a4, read_only_parent: Some(Volume { block_size: 512, id: c90e4ca8-5402-4f47-bc8d-264a1d9bafe4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e244728e-3321-4411-a1ea-1c946d45f6b0, key: Some("fKPANsnWIaKiZWXpJHP4ovXvNkoD3DYjlrKIeVlqe/A="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5ae4c937-80e8-4651-b9f8-fda80aae47a4, key: Some("l+FjyqmWhGUQl0aUPcqInUweNb1h26v8G3aMHjtsGCM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAABIHJkbWRtZAAAcmRtZAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAASRyZG1kbWQAAHJkbWQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJlYTE1Yzg1Yi01NWU5LTQ0MTEtYjU1Yy0xMTFkMmYzMTY5YTEiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJR0s0Wi9vMEY5eUN4RWd3K291ZnBSTVM0bVlGbTNGSHJETE5vazJzZWIzZCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 instance_runtime = InstanceRuntimeState { propolis_id: Some(dd24bc72-91af-4d1d-b95a-7efe8169b70c (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-08-27T19:08:56.413010684Z } metadata = InstanceMetadata { silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, project_id: 8683e81c-6acc-43da-b354-ef69ca6c8c85 } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-08-27T19:08:56.365532Z }
19722024-08-27T19:08:56.783ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:603 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
19732024-08-27T19:08:56.783ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:990 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 migration_id = None propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 3141ecdf-594e-4e44-b7f0-f13984811679, kind: Instance { id: ea15c85b-55e9-4411-b55c-111d2f3169a1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5493020), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3141ecdf-594e-4e44-b7f0-f13984811679, kind: Instance { id: ea15c85b-55e9-4411-b55c-111d2f3169a1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5493020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3141ecdf-594e-4e44-b7f0-f13984811679, kind: Instance { id: ea15c85b-55e9-4411-b55c-111d2f3169a1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5493020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5493020))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3141ecdf-594e-4e44-b7f0-f13984811679, kind: Instance { id: ea15c85b-55e9-4411-b55c-111d2f3169a1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 254, 100, 136])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5493020), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-5731b2ab747", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5ae4c937-80e8-4651-b9f8-fda80aae47a4, read_only_parent: Some(Volume { block_size: 512, id: c90e4ca8-5402-4f47-bc8d-264a1d9bafe4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e244728e-3321-4411-a1ea-1c946d45f6b0, key: Some("fKPANsnWIaKiZWXpJHP4ovXvNkoD3DYjlrKIeVlqe/A="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5ae4c937-80e8-4651-b9f8-fda80aae47a4, key: Some("l+FjyqmWhGUQl0aUPcqInUweNb1h26v8G3aMHjtsGCM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAABIHJkbWRtZAAAcmRtZAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAASRyZG1kbWQAAHJkbWQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJlYTE1Yzg1Yi01NWU5LTQ0MTEtYjU1Yy0xMTFkMmYzMTY5YTEiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJR0s0Wi9vMEY5eUN4RWd3K291ZnBSTVM0bVlGbTNGSHJETE5vazJzZWIzZCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-08-27T19:08:56.365532Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
19742024-08-27T19:08:56.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 14231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51908 req_id = 1f916a70-a0e9-43e1-854a-450b1744a502 response_code = 200 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c
19752024-08-27T19:08:56.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45679
19762024-08-27T19:08:56.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1099 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45679 req_id = cddf13e9-6375-451c-92de-ef548c8dd59c response_code = 200 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c/state
19772024-08-27T19:08:56.879ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:424 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 254, 100, 136]), slot: 0, vni: Vni { inner: 5493020 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
19782024-08-27T19:08:56.880ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
19792024-08-27T19:08:56.919ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c file = illumos-utils/src/zone.rs:316 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
19802024-08-27T19:08:56.941ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c file = illumos-utils/src/zone.rs:354 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
19812024-08-27T19:08:58.233ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
19822024-08-27T19:08:58.233ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c zone file = illumos-utils/src/running_zone.rs:488 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
19832024-08-27T19:08:58.412ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c") failed: Property not found. retry in 46.7333ms file = illumos-utils/src/svc.rs:36 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
19842024-08-27T19:08:58.467ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c") failed: Property not found. retry in 119.702179ms file = illumos-utils/src/svc.rs:36 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
19852024-08-27T19:08:58.609ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c") failed: Property not found. retry in 153.486249ms file = illumos-utils/src/svc.rs:36 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
19862024-08-27T19:08:58.781ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c") failed: Property not found. retry in 524.033047ms file = illumos-utils/src/svc.rs:36 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
19872024-08-27T19:08:59.316ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c") failed: Property not found. retry in 414.126229ms file = illumos-utils/src/svc.rs:36 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
19882024-08-27T19:08:59.742ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c") failed: Property not found. retry in 1.330843659s file = illumos-utils/src/svc.rs:36 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
19892024-08-27T19:09:00.348ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44450
19902024-08-27T19:09:00.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 891 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44450 req_id = 824d4eab-fc7a-442d-83c8-405cad9e16a2 response_code = 200 uri = /vpc-routes
19912024-08-27T19:09:00.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40285
19922024-08-27T19:09:00.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34244
19932024-08-27T19:09:00.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1048 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34244 req_id = 4d72945c-09c9-40ae-9f08-75aeb6832aee response_code = 200 uri = /v2p
19942024-08-27T19:09:00.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41954
19952024-08-27T19:09:00.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44450 req_id = 9467915d-2965-4079-b97a-a9a9a0939f9c response_code = 204 uri = /vpc-routes
19962024-08-27T19:09:00.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34589
19972024-08-27T19:09:00.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34589 req_id = 3b55eda2-9e6c-4aa5-85c8-59720d7dce9e response_code = 200 uri = /vpc-routes
19982024-08-27T19:09:00.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 995 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34589 req_id = 4a20f577-c115-4924-a0a6-f466a9f3c620 response_code = 204 uri = /vpc-routes
19992024-08-27T19:09:00.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42831
20002024-08-27T19:09:00.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42831 req_id = 55410b0c-b962-4364-a6f2-df825c276514 response_code = 200 uri = /v2p
20012024-08-27T19:09:00.539ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44340
20022024-08-27T19:09:00.539ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
20032024-08-27T19:09:00.575ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
20042024-08-27T19:09:00.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 93644 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44340 req_id = 58b3f0e9-f073-4a71-a81f-f0f4f9962098 response_code = 204 uri = /switch-ports
20052024-08-27T19:09:00.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44340 req_id = 4dc555f0-4002-49dc-b7c8-7453fe5844d4 response_code = 200 uri = /network-bootstore-config
20062024-08-27T19:09:00.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47985
20072024-08-27T19:09:00.645ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
20082024-08-27T19:09:00.681ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
20092024-08-27T19:09:00.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 94772 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47985 req_id = eca1ec4f-396a-4383-89e4-362cf25be154 response_code = 204 uri = /switch-ports
20102024-08-27T19:09:00.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47985 req_id = b18bf149-12e1-42f4-8913-25a3b2580237 response_code = 200 uri = /network-bootstore-config
20112024-08-27T19:09:01.084ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c") failed: Property not found. retry in 1.393550752s file = illumos-utils/src/svc.rs:36 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
20122024-08-27T19:09:01.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39335
20132024-08-27T19:09:01.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39335 req_id = 7fc4e63f-f7b2-4f2a-b307-5c7e1dc72a1d response_code = 200 uri = /vpc-routes
20142024-08-27T19:09:01.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 895 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39335 req_id = 2d876a54-fb00-48d5-aee6-15fdec5fe268 response_code = 204 uri = /vpc-routes
20152024-08-27T19:09:01.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40424
20162024-08-27T19:09:01.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40015
20172024-08-27T19:09:01.560ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40015 req_id = b89aec4f-e21f-4f64-9d14-7a10a01a73da response_code = 200 uri = /v2p
20182024-08-27T19:09:01.628ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51704
20192024-08-27T19:09:01.629ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4033
20202024-08-27T19:09:01.667ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4057
20212024-08-27T19:09:01.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 92676 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51704 req_id = 018519dd-26f7-4b90-a643-663dcdf906a8 response_code = 204 uri = /switch-ports
20222024-08-27T19:09:01.722ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51704 req_id = ba8fce57-fb3d-4317-a3eb-176b60dedab6 response_code = 200 uri = /network-bootstore-config
20232024-08-27T19:09:02.488ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c") failed: Property not found. retry in 617.056263ms file = illumos-utils/src/svc.rs:36 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
20242024-08-27T19:09:03.117ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c") failed: Property not found. retry in 1.131186652s file = illumos-utils/src/svc.rs:36 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c zone = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
20252024-08-27T19:09:04.279ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c file = sled-agent/src/instance.rs:1448 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20262024-08-27T19:09:04.288ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1457 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20272024-08-27T19:09:04.335ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1481 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20282024-08-27T19:09:04.336ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAABIHJkbWRtZAAAcmRtZAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAASRyZG1kbWQAAHJkbWQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiJlYTE1Yzg1Yi01NWU5LTQ0MTEtYjU1Yy0xMTFkMmYzMTY5YTEiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJR0s0Wi9vMEY5eUN4RWd3K291ZnBSTVM0bVlGbTNGSHJETE5vazJzZWIzZCJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-5731b2ab747", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: 5ae4c937-80e8-4651-b9f8-fda80aae47a4, read_only_parent: Some(Volume { block_size: 512, id: c90e4ca8-5402-4f47-bc8d-264a1d9bafe4, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: e244728e-3321-4411-a1ea-1c946d45f6b0, key: Some("fKPANsnWIaKiZWXpJHP4ovXvNkoD3DYjlrKIeVlqe/A="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::14]:19001", "[fd00:1122:3344:101::15]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 5ae4c937-80e8-4651-b9f8-fda80aae47a4, key: Some("l+FjyqmWhGUQl0aUPcqInUweNb1h26v8G3aMHjtsGCM="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::18]:19000", "[fd00:1122:3344:101::13]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "opte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: ea15c85b-55e9-4411-b55c-111d2f3169a1, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: 8683e81c-6acc-43da-b354-ef69ca6c8c85, silo_id: d5f4de10-86a1-47de-980c-717d10d0f131, sled_id: e38b401b-2d22-4589-ac73-fc644b0a15b2, sled_model: "i86pc", sled_revision: 0, sled_serial: "buskin" }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:724 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20292024-08-27T19:09:04.474ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:726 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20302024-08-27T19:09:04.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4114015 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40285 req_id = 4ae1ebcf-b39d-443f-863d-4d9a4dad0fb7 response_code = 200 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c/state
20312024-08-27T19:09:04.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2922842 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40424 req_id = 840489d7-daeb-499c-abb5-8379910dc56d response_code = 200 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c/state
20322024-08-27T19:09:04.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4091658 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41954 req_id = 14271bd4-610f-4aed-9108-fe796f7ebfd9 response_code = 200 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c/state
20332024-08-27T19:09:04.477ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2024-08-27T19:09:04.477098060Z } file = sled-agent/src/instance.rs:593 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20342024-08-27T19:09:04.477ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:615 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-27T19:09:04.477098060Z } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20352024-08-27T19:09:04.477ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:513 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-27T19:09:04.477098060Z }, migration_in: None, migration_out: None }
20362024-08-27T19:09:04.517ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2024-08-27T19:09:04.517367442Z } file = sled-agent/src/instance.rs:593 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20372024-08-27T19:09:04.517ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:615 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-27T19:09:04.517367442Z } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20382024-08-27T19:09:04.517ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:513 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-27T19:09:04.517367442Z }, migration_in: None, migration_out: None }
20392024-08-27T19:09:08.269ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55417
20402024-08-27T19:09:08.269ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 129 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55417 req_id = af380bce-f0d9-4fbe-8178-5b10eab6cb38 response_code = 200 uri = /baseboard
20412024-08-27T19:09:13.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55915
20422024-08-27T19:09:13.689ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55915 req_id = 8606340c-9236-401d-8257-75156de37e6a response_code = 200 uri = /vmms/dd24bc72-91af-4d1d-b95a-7efe8169b70c/state
20432024-08-27T19:09:13.690ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2024-08-27T19:09:13.690091352Z } file = sled-agent/src/instance.rs:593 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20442024-08-27T19:09:13.690ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:615 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-27T19:09:13.690091352Z } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20452024-08-27T19:09:13.690ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:513 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-27T19:09:13.690091352Z }, migration_in: None, migration_out: None }
20462024-08-27T19:09:13.721ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2024-08-27T19:09:13.721723679Z } file = sled-agent/src/instance.rs:593 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20472024-08-27T19:09:13.721ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:615 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-08-27T19:09:13.721723679Z } propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20482024-08-27T19:09:13.721ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:629 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20492024-08-27T19:09:13.721ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
20502024-08-27T19:09:13.725ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
20512024-08-27T19:09:13.725ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/861e54cf-f95e-47d9-b389-b519c9faa394/debug/bundle/zone", "/pool/int/b66efe43-f3db-4ebe-bf21-a63dbb6594b9/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/da7c3e21-7c55-491f-981e-80aa62a13bf6/crypt/debug", "/pool/ext/4d6a88f2-a8fa-422c-8e55-4ef0c6f8378e/crypt/debug", "/pool/ext/558a4fa3-16b9-4e7c-8ac0-a40723ece2de/crypt/debug", "/pool/ext/c75d3f85-2b4d-4485-aa90-58be246da1bc/crypt/debug", "/pool/ext/ece87f46-247e-409b-ad26-6e8e96c7e756/crypt/debug", "/pool/ext/6a874446-59c2-4b92-800d-d0a1bfbe68dd/crypt/debug", "/pool/ext/030f20e2-2758-4a47-92fd-4adaf0953899/crypt/debug", "/pool/ext/a954bc02-0277-475f-b5f2-befa522b2371/crypt/debug", "/pool/ext/c21168f7-9204-4a38-9c41-94555fc3bf91/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c
20522024-08-27T19:09:14.353ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1137 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c", bundle_id: dc2c2cbf-bdc4-4b25-9bac-b1d18a6b3a9d }, time_created: 2024-08-27T19:09:13.725510596Z, version: 0, cause: TerminatedInstance }
20532024-08-27T19:09:14.353ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_dd24bc72-91af-4d1d-b95a-7efe8169b70c file = sled-agent/src/instance.rs:825 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20542024-08-27T19:09:15.184ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
20552024-08-27T19:09:15.184ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
20562024-08-27T19:09:15.225ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1899, tv_nsec: 891052927 } time_to_next_cleanup = 599.99999593s
20572024-08-27T19:09:16.106ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:270 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20582024-08-27T19:09:16.123ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(5493020), kind: System }
20592024-08-27T19:09:16.123ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:904 id = RouterId { vni: Vni(5493020), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
20602024-08-27T19:09:16.124ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:513 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-27T19:09:16.124163413Z }, migration_in: None, migration_out: None }
20612024-08-27T19:09:16.165ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:513 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-27T19:09:16.124163413Z }, migration_in: None, migration_out: None }
20622024-08-27T19:09:16.169ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:762 instance_id = ea15c85b-55e9-4411-b55c-111d2f3169a1 propolis_id = dd24bc72-91af-4d1d-b95a-7efe8169b70c
20632024-08-27T19:09:16.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42770
20642024-08-27T19:09:16.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42770 req_id = b940fb18-6540-4647-84f0-188939cf825f response_code = 200 uri = /vpc-routes
20652024-08-27T19:09:16.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42770 req_id = f160172d-e0cc-4bdd-a7f7-7a4ad2618da7 response_code = 204 uri = /vpc-routes
20662024-08-27T19:09:16.715ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64642
20672024-08-27T19:09:16.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64642 req_id = 8c0b4043-e4f9-4872-9efa-cbf3e7e2f447 response_code = 200 uri = /v2p
20682024-08-27T19:09:18.099ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54153
20692024-08-27T19:09:18.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54153 req_id = d075f0dd-8536-42e0-94a5-dbcffb7aeb1e response_code = 200 uri = /v2p
20702024-08-27T19:09:19.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38215
20712024-08-27T19:09:19.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38215 req_id = 7f1cda18-e621-4411-9893-14004c23979b response_code = 200 uri = /vpc-routes
20722024-08-27T19:09:19.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38215 req_id = effd24f3-ed31-4ece-b56f-3e994d8d2e27 response_code = 204 uri = /vpc-routes