Max level shown:
1 [ Jun 28 20:18:18 Enabled. ]
2 [ Jun 28 20:18:18 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jun 28 20:18:18 Method "start" exited with status 0. ]
4 [ Jun 28 20:18:18 Rereading configuration. ]
5 [ Jun 28 20:18:18 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72024-06-28T20:18:18.663ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:163
82024-06-28T20:18:18.663ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92024-06-28T20:18:18.717ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102024-06-28T20:18:18.717ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112024-06-28T20:18:18.832ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122024-06-28T20:18:18.841ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132024-06-28T20:18:18.849ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142024-06-28T20:18:19.453ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152024-06-28T20:18:19.594ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:119
162024-06-28T20:18:19.594ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:131
172024-06-28T20:18:19.594ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:141
182024-06-28T20:18:19.594ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:162 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192024-06-28T20:18:19.594ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:506
202024-06-28T20:18:19.594ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:703
212024-06-28T20:18:19.597ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:610
222024-06-28T20:18:19.597ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:752
232024-06-28T20:18:19.597ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:176
242024-06-28T20:18:19.597ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:811
252024-06-28T20:18:19.597ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_0.vdev
262024-06-28T20:18:19.597ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272024-06-28T20:18:19.597ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
282024-06-28T20:18:19.597ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292024-06-28T20:18:19.597ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302024-06-28T20:18:19.609ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:361
312024-06-28T20:18:19.609ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:372 id = 893e883e-0735-4681-80b4-298a478763ff (zpool)
322024-06-28T20:18:19.705ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal }
332024-06-28T20:18:19.907ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:406
342024-06-28T20:18:19.907ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/m2_1.vdev
352024-06-28T20:18:19.907ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362024-06-28T20:18:19.907ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372024-06-28T20:18:19.907ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
382024-06-28T20:18:19.907ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392024-06-28T20:18:19.907ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402024-06-28T20:18:19.916ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:361
412024-06-28T20:18:19.916ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:372 id = 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool)
422024-06-28T20:18:20.003ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal }
432024-06-28T20:18:20.208ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_0.vdev
442024-06-28T20:18:20.208ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
452024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
462024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
472024-06-28T20:18:20.208ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
482024-06-28T20:18:20.208ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492024-06-28T20:18:20.208ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_1.vdev
502024-06-28T20:18:20.208ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
512024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
522024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
532024-06-28T20:18:20.208ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
542024-06-28T20:18:20.208ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552024-06-28T20:18:20.208ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_2.vdev
562024-06-28T20:18:20.208ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
572024-06-28T20:18:20.208ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
582024-06-28T20:18:20.208ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
592024-06-28T20:18:20.208ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_3.vdev
602024-06-28T20:18:20.208ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
612024-06-28T20:18:20.208ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
622024-06-28T20:18:20.208ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
632024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
642024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
652024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
662024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
672024-06-28T20:18:20.208ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_4.vdev
682024-06-28T20:18:20.208ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
692024-06-28T20:18:20.208ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
702024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
712024-06-28T20:18:20.208ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
722024-06-28T20:18:20.208ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732024-06-28T20:18:20.208ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_5.vdev
742024-06-28T20:18:20.208ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
752024-06-28T20:18:20.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
762024-06-28T20:18:20.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772024-06-28T20:18:20.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
782024-06-28T20:18:20.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
792024-06-28T20:18:20.209ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_6.vdev
802024-06-28T20:18:20.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
812024-06-28T20:18:20.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
822024-06-28T20:18:20.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832024-06-28T20:18:20.209ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
842024-06-28T20:18:20.209ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
852024-06-28T20:18:20.209ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_7.vdev
862024-06-28T20:18:20.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
872024-06-28T20:18:20.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882024-06-28T20:18:20.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
892024-06-28T20:18:20.209ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:232 vdev = /scratch/u2_8.vdev
902024-06-28T20:18:20.209ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }), tx: ... } file = sled-storage/src/manager.rs:406
912024-06-28T20:18:20.209ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:495 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
922024-06-28T20:18:20.209ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
932024-06-28T20:18:20.211ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:91
942024-06-28T20:18:20.211ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:93
952024-06-28T20:18:20.211ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
962024-06-28T20:18:20.211ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
972024-06-28T20:18:20.211ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
982024-06-28T20:18:20.211ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
992024-06-28T20:18:20.211ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1002024-06-28T20:18:20.211ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1012024-06-28T20:18:20.211ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
1022024-06-28T20:18:20.211ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
1032024-06-28T20:18:20.211ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:200
1042024-06-28T20:18:20.211ZINFOSledAgent (bootstore): No ledger in /pool/int/893e883e-0735-4681-80b4-298a478763ff/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052024-06-28T20:18:20.211ZINFOSledAgent (bootstore): No ledger in /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062024-06-28T20:18:20.211ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072024-06-28T20:18:20.211ZINFOSledAgent (bootstore): No ledger in /pool/int/893e883e-0735-4681-80b4-298a478763ff/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082024-06-28T20:18:20.211ZINFOSledAgent (bootstore): No ledger in /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092024-06-28T20:18:20.211ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102024-06-28T20:18:20.211ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:205
1112024-06-28T20:18:20.211ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:220
1122024-06-28T20:18:20.220ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:712
1132024-06-28T20:18:20.220ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:289 next_cleanup = Instant { tv_sec: 4140, tv_nsec: 951023826 } time_to_next_cleanup = 599.99995279s
1142024-06-28T20:18:20.220ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3557
1152024-06-28T20:18:20.220ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1162024-06-28T20:18:20.220ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/sled-agent-request.json file = common/src/ledger.rs:188
1172024-06-28T20:18:20.222ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/sled-agent-request.json file = common/src/ledger.rs:188
1182024-06-28T20:18:20.223ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192024-06-28T20:18:20.223ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:44 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202024-06-28T20:18:20.223ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1011
1212024-06-28T20:18:20.223ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1222024-06-28T20:18:20.223ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1232024-06-28T20:18:20.223ZINFOSledAgent (RSS): No ledger in /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242024-06-28T20:18:20.223ZINFOSledAgent (RSS): No ledger in /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252024-06-28T20:18:20.223ZINFOSledAgent (RSS): RSS configuration has not been fully applied yet file = sled-agent/src/rack_setup/service.rs:1071
1262024-06-28T20:18:20.223ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1272024-06-28T20:18:20.223ZINFOSledAgent (RSS): No ledger in /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/rss-sled-plan.json file = common/src/ledger.rs:188
1282024-06-28T20:18:20.223ZINFOSledAgent (RSS): No ledger in /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/rss-sled-plan.json file = common/src/ledger.rs:188
1292024-06-28T20:18:20.223ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1112
1302024-06-28T20:18:20.223ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:156
1312024-06-28T20:18:20.223ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:129
1322024-06-28T20:18:20.223ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1332024-06-28T20:18:20.223ZINFOSledAgent (RSS): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1342024-06-28T20:18:20.224ZINFOSledAgent (RSS): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/.rss-sled-plan.json.tmp file = common/src/ledger.rs:199
1352024-06-28T20:18:20.224ZINFOSledAgent (RSS): Sled plan written to storage file = sled-agent/src/rack_setup/plan/sled.rs:176
1362024-06-28T20:18:20.224ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1145
1372024-06-28T20:18:20.224ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1382024-06-28T20:18:20.224ZINFOSledAgent (bootstore): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1392024-06-28T20:18:20.224ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1402024-06-28T20:18:20.224ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1412024-06-28T20:18:20.224ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:217 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e6aa3805-f338-41a1-9087-e851abde3933, rack_id: ca9c69df-17fe-4aff-be49-d2dc33212dbe, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1422024-06-28T20:18:20.225ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:66 remote_addr = [fdb0:18c0:4d0d:a02a::1]:56391
1432024-06-28T20:18:20.225ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e6aa3805-f338-41a1-9087-e851abde3933, rack_id: ca9c69df-17fe-4aff-be49-d2dc33212dbe, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:360
1442024-06-28T20:18:20.225ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:375
1452024-06-28T20:18:20.225ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:406
1462024-06-28T20:18:20.225ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1472024-06-28T20:18:20.225ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:574
1482024-06-28T20:18:20.225ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
1492024-06-28T20:18:20.225ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1502024-06-28T20:18:20.225ZINFOSledAgent (StorageManager): No ledger in /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1512024-06-28T20:18:20.225ZINFOSledAgent (StorageManager): No ledger in /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_ledger
1522024-06-28T20:18:20.225ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:563
1532024-06-28T20:18:20.225ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:591
1542024-06-28T20:18:20.228ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:3789
1552024-06-28T20:18:20.237ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:647 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
1562024-06-28T20:18:20.247ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:647 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
1572024-06-28T20:18:20.258ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:647 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
1582024-06-28T20:18:20.267ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:647 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
1592024-06-28T20:18:20.276ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:647 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
1602024-06-28T20:18:20.284ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:647 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
1612024-06-28T20:18:20.292ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:355 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
1622024-06-28T20:18:20.292ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1632024-06-28T20:18:20.293ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 124.049903ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "98188c49-53c3-427e-b323-e5f045e53836", "content-length": "124", "date": "Fri, 28 Jun 2024 20:18:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "98188c49-53c3-427e-b323-e5f045e53836" } file = clients/ddm-admin-client/src/lib.rs:177
1642024-06-28T20:18:20.293ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:647 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
1652024-06-28T20:18:20.301ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:647 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
1662024-06-28T20:18:20.309ZINFOSledAgent (StorageManager): Zpool does not exist err = ZpoolDoesNotExist file = sled-storage/src/manager.rs:647 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
1672024-06-28T20:18:20.309ZINFOSledAgent (StorageManager): No disks to be automatically managed file = sled-storage/src/manager.rs:602
1682024-06-28T20:18:20.309ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:395
1692024-06-28T20:18:20.309ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:340
1702024-06-28T20:18:20.309ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:481 result = DisksManagementResult { status: [] }
1712024-06-28T20:18:20.309ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1722024-06-28T20:18:20.309ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
1732024-06-28T20:18:20.309ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:367 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
1742024-06-28T20:18:20.322ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_893e883e-0735-4681-80b4-298a478763ff/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1752024-06-28T20:18:20.334ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:315
1762024-06-28T20:18:20.345ZINFOSledAgent: successfully created encrypted zvol: name="oxi_893e883e-0735-4681-80b4-298a478763ff/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1772024-06-28T20:18:20.345ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_893e883e-0735-4681-80b4-298a478763ff/swap" file = sled-agent/src/swap_device.rs:96
1782024-06-28T20:18:20.350ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:382 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
1792024-06-28T20:18:20.350ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:126
1802024-06-28T20:18:20.350ZINFOSledAgent (BackingFs): Ensuring dataset oxi_893e883e-0735-4681-80b4-298a478763ff/backing/fmd file = sled-agent/src/backing_fs.rs:136
1812024-06-28T20:18:20.352ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:354
1822024-06-28T20:18:20.418ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1832024-06-28T20:18:20.419ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 89.466091ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2b09a301-9772-4ac1-b935-f9cace5cc307", "content-length": "124", "date": "Fri, 28 Jun 2024 20:18:19 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2b09a301-9772-4ac1-b935-f9cace5cc307" } file = clients/ddm-admin-client/src/lib.rs:177
1842024-06-28T20:18:20.419ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:170
1852024-06-28T20:18:20.510ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862024-06-28T20:18:20.510ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 96.310527ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "34c5005f-3e37-4964-8966-574a3cefbe98", "content-length": "124", "date": "Fri, 28 Jun 2024 20:18:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "34c5005f-3e37-4964-8966-574a3cefbe98" } file = clients/ddm-admin-client/src/lib.rs:177
1872024-06-28T20:18:20.607ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882024-06-28T20:18:20.608ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 209.263596ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a3655ac1-e693-4d9a-88f9-8b4301fac48d", "content-length": "124", "date": "Fri, 28 Jun 2024 20:18:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a3655ac1-e693-4d9a-88f9-8b4301fac48d" } file = clients/ddm-admin-client/src/lib.rs:177
1892024-06-28T20:18:20.637ZINFOSledAgent (BackingFs): Mounting oxi_893e883e-0735-4681-80b4-298a478763ff/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:178
1902024-06-28T20:18:20.650ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:186
1912024-06-28T20:18:20.650ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:186
1922024-06-28T20:18:20.650ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:186
1932024-06-28T20:18:20.650ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:192
1942024-06-28T20:18:20.819ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1952024-06-28T20:18:20.820ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 247.507603ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "832a18b4-586a-4c78-8ee9-1f7b4d31eb92", "content-length": "124", "date": "Fri, 28 Jun 2024 20:18:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "832a18b4-586a-4c78-8ee9-1f7b4d31eb92" } file = clients/ddm-admin-client/src/lib.rs:177
1962024-06-28T20:18:21.069ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1972024-06-28T20:18:21.070ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 255.018591ms DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3c1aefd9-c58f-4204-95fd-de8b9906383e", "content-length": "124", "date": "Fri, 28 Jun 2024 20:18:20 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3c1aefd9-c58f-4204-95fd-de8b9906383e" } file = clients/ddm-admin-client/src/lib.rs:177
1982024-06-28T20:18:21.325ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1992024-06-28T20:18:21.344ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:90 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2002024-06-28T20:18:21.345ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:37179 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2012024-06-28T20:18:21.345ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2022024-06-28T20:18:21.345ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:37179 file = oximeter/producer/src/lib.rs:282 interval = 30s producer_id = e6aa3805-f338-41a1-9087-e851abde3933 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2032024-06-28T20:18:21.351ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 192.445787ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2042024-06-28T20:18:21.392ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2052024-06-28T20:18:21.392ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2062024-06-28T20:18:21.392ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:895 underlay_address = fd00:1122:3344:101::1
2072024-06-28T20:18:21.392ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53, [fd00:1122:3344:4::1]:53, [fd00:1122:3344:5::1]:53] file = internal-dns/src/resolver.rs:60
2082024-06-28T20:18:21.392ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:196 local_addr = [fd00:1122:3344:101::1]:12345
2092024-06-28T20:18:21.392ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:430
2102024-06-28T20:18:21.392ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2112024-06-28T20:18:21.392ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2122024-06-28T20:18:21.393ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2132024-06-28T20:18:21.393ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2142024-06-28T20:18:21.393ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: None, bgp_peers: [], autoneg: false }], bgp: [], bfd: [] })))
2152024-06-28T20:18:21.393ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:73 remote_addr = [fdb0:18c0:4d0d:a02a::1]:56391
2162024-06-28T20:18:21.393ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3557
2172024-06-28T20:18:21.393ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:108 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2182024-06-28T20:18:21.393ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:232 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2192024-06-28T20:18:21.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2202024-06-28T20:18:21.589ZINFOSledAgent (RSS): No ledger in /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2212024-06-28T20:18:21.589ZINFOSledAgent (RSS): No ledger in /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/rss-service-plan-v3.json file = common/src/ledger.rs:188
2222024-06-28T20:18:21.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2232024-06-28T20:18:21.589ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2242024-06-28T20:18:21.590ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 533.979476ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2252024-06-28T20:18:21.594ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2262024-06-28T20:18:21.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47678
2272024-06-28T20:18:21.622ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2282024-06-28T20:18:21.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47678 req_id = 2b1b27f2-bbc0-47ca-b6ac-33cbfa19623e response_code = 200 uri = /inventory
2292024-06-28T20:18:21.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41289
2302024-06-28T20:18:21.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41289 req_id = 105564e2-a659-424d-a296-9290a4601ba1 response_code = 200 uri = /sled-role
2312024-06-28T20:18:21.659ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
2322024-06-28T20:18:21.659ZINFOSledAgent (RSS): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2332024-06-28T20:18:21.659ZINFOSledAgent (RSS): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/.rss-service-plan-v3.json.tmp file = common/src/ledger.rs:199
2342024-06-28T20:18:21.659ZINFOSledAgent (RSS): Service plan written to storage file = sled-agent/src/rack_setup/plan/service.rs:812
2352024-06-28T20:18:21.690ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { disks: [OmicronPhysicalDiskConfig { id: a089a385-9a13-466d-ba8e-2c9496f91966, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, pool_id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool) }, OmicronPhysicalDiskConfig { id: 42607c0d-ca64-4e5b-b6ed-c3f037dc14a6, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, pool_id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool) }, OmicronPhysicalDiskConfig { id: 247fe6e4-e408-4bdc-8082-67cd3aa6a5f4, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, pool_id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool) }, OmicronPhysicalDiskConfig { id: e6ece4cd-1f25-4333-98d2-625030affa1b, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, pool_id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool) }, OmicronPhysicalDiskConfig { id: 96de369d-82be-46b7-bd7e-8843c0e081e7, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, pool_id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool) }, OmicronPhysicalDiskConfig { id: cb00f19c-8258-42d4-8593-f579ac7e8df2, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, pool_id: ddccf8a3-466c-4983-9045-85a61a2f0cb5 (zpool) }, OmicronPhysicalDiskConfig { id: 43283f8c-eadd-4f5f-9589-ed32f8c0774a, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, pool_id: 70d817e0-8838-4d86-ae6d-cb77ce8a3e35 (zpool) }, OmicronPhysicalDiskConfig { id: 4e44d2f0-873f-4abb-a8a5-ffb31a5a4d4b, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, pool_id: 6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11 (zpool) }, OmicronPhysicalDiskConfig { id: 45418c35-922d-47fb-95a6-16b76ab2ec46, identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, pool_id: b1b0311e-24a0-4d3f-b298-78dc98cee0a2 (zpool) }], generation: Generation(1) } file = sled-agent/src/rack_setup/service.rs:348 sled_address = [fd00:1122:3344:101::1]:12345
2362024-06-28T20:18:21.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60399
2372024-06-28T20:18:21.690ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(1), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: a089a385-9a13-466d-ba8e-2c9496f91966, pool_id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 42607c0d-ca64-4e5b-b6ed-c3f037dc14a6, pool_id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 247fe6e4-e408-4bdc-8082-67cd3aa6a5f4, pool_id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: e6ece4cd-1f25-4333-98d2-625030affa1b, pool_id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 96de369d-82be-46b7-bd7e-8843c0e081e7, pool_id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: cb00f19c-8258-42d4-8593-f579ac7e8df2, pool_id: ddccf8a3-466c-4983-9045-85a61a2f0cb5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 43283f8c-eadd-4f5f-9589-ed32f8c0774a, pool_id: 70d817e0-8838-4d86-ae6d-cb77ce8a3e35 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 4e44d2f0-873f-4abb-a8a5-ffb31a5a4d4b, pool_id: 6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 45418c35-922d-47fb-95a6-16b76ab2ec46, pool_id: b1b0311e-24a0-4d3f-b298-78dc98cee0a2 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:406
2382024-06-28T20:18:21.690ZINFOSledAgent (StorageManager): No ledger in /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2392024-06-28T20:18:21.690ZINFOSledAgent (StorageManager): No ledger in /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2402024-06-28T20:18:21.690ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:725 request = omicron_physical_disks_ensure
2412024-06-28T20:18:21.690ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:340
2422024-06-28T20:18:21.690ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:380
2432024-06-28T20:18:21.690ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:457
2442024-06-28T20:18:21.690ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2452024-06-28T20:18:21.784ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:361
2462024-06-28T20:18:21.784ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:367 id = 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool)
2472024-06-28T20:18:22.162ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.450259213s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2482024-06-28T20:18:22.595ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2492024-06-28T20:18:22.790ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }
2502024-06-28T20:18:22.970ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:332
2512024-06-28T20:18:22.970ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:334
2522024-06-28T20:18:22.970ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:338
2532024-06-28T20:18:22.970ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:340
2542024-06-28T20:18:22.970ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2552024-06-28T20:18:22.970ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2562024-06-28T20:18:22.970ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2572024-06-28T20:18:23.568ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2582024-06-28T20:18:23.570ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2592024-06-28T20:18:23.756ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_switch
2602024-06-28T20:18:23.919ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/zone file = sled-storage/src/dataset.rs:395
2612024-06-28T20:18:24.336ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.988551423s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2622024-06-28T20:18:24.336ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2632024-06-28T20:18:24.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 32.904066ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2642024-06-28T20:18:24.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 83.874361ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2652024-06-28T20:18:25.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 162.53926ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2662024-06-28T20:18:25.513ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2672024-06-28T20:18:26.050ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2682024-06-28T20:18:26.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 438.796347ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2692024-06-28T20:18:26.866ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5ac4a919-8b24-423d-ad25-5b564847ba3f file = sled-storage/src/dataset.rs:480
2702024-06-28T20:18:27.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 917.569016ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2712024-06-28T20:18:27.081ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2722024-06-28T20:18:27.087ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:478
2732024-06-28T20:18:27.087ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:395
2742024-06-28T20:18:27.087ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:380
2752024-06-28T20:18:27.087ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:457
2762024-06-28T20:18:27.087ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2772024-06-28T20:18:27.330ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:361
2782024-06-28T20:18:27.330ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:367 id = e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool)
2792024-06-28T20:18:28.501ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }
2802024-06-28T20:18:28.725ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:332
2812024-06-28T20:18:28.725ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:334
2822024-06-28T20:18:28.725ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:338
2832024-06-28T20:18:28.725ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:340
2842024-06-28T20:18:28.725ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2852024-06-28T20:18:28.725ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2862024-06-28T20:18:28.725ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
2872024-06-28T20:18:29.475ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.523560753s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2882024-06-28T20:18:29.475ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2892024-06-28T20:18:29.704ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2902024-06-28T20:18:30.205ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2912024-06-28T20:18:30.693ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/zone file = sled-storage/src/dataset.rs:395
2922024-06-28T20:18:30.924ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2932024-06-28T20:18:30.924ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2942024-06-28T20:18:31.394ZINFOSledAgent (ServiceManager): Ensuring tfportrear0_0/ll exists in zone file = sled-agent/src/services.rs:2243
2952024-06-28T20:18:31.610ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
2962024-06-28T20:18:31.720ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e2ec5a14-af67-4734-9131-7da5563a61e7 file = sled-storage/src/dataset.rs:480
2972024-06-28T20:18:31.728ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:478
2982024-06-28T20:18:31.728ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:395
2992024-06-28T20:18:31.728ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:380
3002024-06-28T20:18:31.728ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:457
3012024-06-28T20:18:31.728ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3022024-06-28T20:18:31.738ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:361
3032024-06-28T20:18:31.738ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:367 id = d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool)
3042024-06-28T20:18:31.830ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }
3052024-06-28T20:18:31.837ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:332
3062024-06-28T20:18:31.837ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:334
3072024-06-28T20:18:31.837ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:338
3082024-06-28T20:18:31.837ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:340
3092024-06-28T20:18:31.837ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102024-06-28T20:18:31.838ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3112024-06-28T20:18:31.838ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3122024-06-28T20:18:31.872ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3132024-06-28T20:18:31.880ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/zone file = sled-storage/src/dataset.rs:395
3142024-06-28T20:18:31.926ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
3152024-06-28T20:18:32.006ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d4198ec9-f3b5-46ff-8674-42aeb9de5463 file = sled-storage/src/dataset.rs:480
3162024-06-28T20:18:32.015ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:478
3172024-06-28T20:18:32.015ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:395
3182024-06-28T20:18:32.015ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:380
3192024-06-28T20:18:32.015ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:457
3202024-06-28T20:18:32.015ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3212024-06-28T20:18:32.024ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:361
3222024-06-28T20:18:32.024ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:367 id = c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool)
3232024-06-28T20:18:32.117ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External }
3242024-06-28T20:18:32.125ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:332
3252024-06-28T20:18:32.125ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:334
3262024-06-28T20:18:32.125ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:338
3272024-06-28T20:18:32.125ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:340
3282024-06-28T20:18:32.125ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292024-06-28T20:18:32.126ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3302024-06-28T20:18:32.126ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3312024-06-28T20:18:32.162ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3322024-06-28T20:18:32.170ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/zone file = sled-storage/src/dataset.rs:395
3332024-06-28T20:18:32.293ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_c1542ec6-6c29-4611-9b23-92e37a62d021 file = sled-storage/src/dataset.rs:480
3342024-06-28T20:18:32.302ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:478
3352024-06-28T20:18:32.302ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:395
3362024-06-28T20:18:32.302ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:380
3372024-06-28T20:18:32.302ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:457
3382024-06-28T20:18:32.302ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3392024-06-28T20:18:32.312ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:361
3402024-06-28T20:18:32.312ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:367 id = fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool)
3412024-06-28T20:18:32.406ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External }
3422024-06-28T20:18:32.415ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:332
3432024-06-28T20:18:32.415ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:334
3442024-06-28T20:18:32.415ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:338
3452024-06-28T20:18:32.415ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:340
3462024-06-28T20:18:32.415ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472024-06-28T20:18:32.415ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3482024-06-28T20:18:32.415ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3492024-06-28T20:18:32.450ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3502024-06-28T20:18:32.458ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/zone file = sled-storage/src/dataset.rs:395
3512024-06-28T20:18:32.583ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fd3016d5-07c4-4b1e-9f22-6b003745d806 file = sled-storage/src/dataset.rs:480
3522024-06-28T20:18:32.591ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:478
3532024-06-28T20:18:32.591ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:395
3542024-06-28T20:18:32.591ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:380
3552024-06-28T20:18:32.591ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:457
3562024-06-28T20:18:32.591ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3572024-06-28T20:18:32.601ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:361
3582024-06-28T20:18:32.601ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:367 id = ddccf8a3-466c-4983-9045-85a61a2f0cb5 (zpool)
3592024-06-28T20:18:32.695ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: ddccf8a3-466c-4983-9045-85a61a2f0cb5 (zpool), kind: External }
3602024-06-28T20:18:32.703ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:332
3612024-06-28T20:18:32.703ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:334
3622024-06-28T20:18:32.703ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:338
3632024-06-28T20:18:32.703ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:340
3642024-06-28T20:18:32.703ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652024-06-28T20:18:32.703ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3662024-06-28T20:18:32.703ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3672024-06-28T20:18:32.728ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
3682024-06-28T20:18:32.737ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3692024-06-28T20:18:32.745ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/zone file = sled-storage/src/dataset.rs:395
3702024-06-28T20:18:32.863ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ddccf8a3-466c-4983-9045-85a61a2f0cb5 file = sled-storage/src/dataset.rs:480
3712024-06-28T20:18:32.871ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:478
3722024-06-28T20:18:32.871ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:395
3732024-06-28T20:18:32.871ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:380
3742024-06-28T20:18:32.871ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:457
3752024-06-28T20:18:32.871ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3762024-06-28T20:18:32.881ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:361
3772024-06-28T20:18:32.881ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:367 id = 70d817e0-8838-4d86-ae6d-cb77ce8a3e35 (zpool)
3782024-06-28T20:18:32.972ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 70d817e0-8838-4d86-ae6d-cb77ce8a3e35 (zpool), kind: External }
3792024-06-28T20:18:32.979ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:332
3802024-06-28T20:18:32.979ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:334
3812024-06-28T20:18:32.979ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:338
3822024-06-28T20:18:32.979ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:340
3832024-06-28T20:18:32.979ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3842024-06-28T20:18:32.979ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3852024-06-28T20:18:32.979ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
3862024-06-28T20:18:32.983ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
3872024-06-28T20:18:33.015ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3882024-06-28T20:18:33.024ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/zone file = sled-storage/src/dataset.rs:395
3892024-06-28T20:18:33.151ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_70d817e0-8838-4d86-ae6d-cb77ce8a3e35 file = sled-storage/src/dataset.rs:480
3902024-06-28T20:18:33.159ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:478
3912024-06-28T20:18:33.160ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:395
3922024-06-28T20:18:33.160ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:380
3932024-06-28T20:18:33.160ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:457
3942024-06-28T20:18:33.160ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3952024-06-28T20:18:33.169ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:361
3962024-06-28T20:18:33.169ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:367 id = 6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11 (zpool)
3972024-06-28T20:18:33.264ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: 6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11 (zpool), kind: External }
3982024-06-28T20:18:33.272ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:332
3992024-06-28T20:18:33.272ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:334
4002024-06-28T20:18:33.272ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:338
4012024-06-28T20:18:33.272ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:340
4022024-06-28T20:18:33.272ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4032024-06-28T20:18:33.273ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042024-06-28T20:18:33.273ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4052024-06-28T20:18:33.308ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4062024-06-28T20:18:33.317ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/zone file = sled-storage/src/dataset.rs:395
4072024-06-28T20:18:33.447ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11 file = sled-storage/src/dataset.rs:480
4082024-06-28T20:18:33.455ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:478
4092024-06-28T20:18:33.455ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:395
4102024-06-28T20:18:33.455ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:380
4112024-06-28T20:18:33.455ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:457
4122024-06-28T20:18:33.455ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:127 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4132024-06-28T20:18:33.465ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:361
4142024-06-28T20:18:33.465ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:367 id = b1b0311e-24a0-4d3f-b298-78dc98cee0a2 (zpool)
4152024-06-28T20:18:33.561ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:288 zpool = ZpoolName { id: b1b0311e-24a0-4d3f-b298-78dc98cee0a2 (zpool), kind: External }
4162024-06-28T20:18:33.568ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:332
4172024-06-28T20:18:33.568ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:334
4182024-06-28T20:18:33.568ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:338
4192024-06-28T20:18:33.568ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:340
4202024-06-28T20:18:33.568ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4212024-06-28T20:18:33.569ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222024-06-28T20:18:33.569ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:352
4232024-06-28T20:18:33.606ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4242024-06-28T20:18:33.615ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/zone file = sled-storage/src/dataset.rs:395
4252024-06-28T20:18:33.741ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b1b0311e-24a0-4d3f-b298-78dc98cee0a2 file = sled-storage/src/dataset.rs:480
4262024-06-28T20:18:33.749ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:478
4272024-06-28T20:18:33.749ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:395
4282024-06-28T20:18:33.749ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4292024-06-28T20:18:33.749ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 893e883e-0735-4681-80b4-298a478763ff (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: ddccf8a3-466c-4983-9045-85a61a2f0cb5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 70d817e0-8838-4d86-ae6d-cb77ce8a3e35 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: 6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, slot_firmware_versions: [Some("synthetic 1.0")] } }, zpool_name: ZpoolName { id: b1b0311e-24a0-4d3f-b298-78dc98cee0a2 (zpool), kind: External } }))}, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:41
4302024-06-28T20:18:33.750ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:549
4312024-06-28T20:18:33.750ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
4322024-06-28T20:18:33.750ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4332024-06-28T20:18:33.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 12059876 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60399 req_id = 41d6dcc8-ff64-43bb-93de-028c51a5787e response_code = 200 uri = /omicron-physical-disks
4342024-06-28T20:18:33.780ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 92532127-cd27-4698-b4c3-8cafe5227066, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7699ce21-4a72-4872-9082-389299b586d4, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
4352024-06-28T20:18:33.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36642
4362024-06-28T20:18:33.781ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 92532127-cd27-4698-b4c3-8cafe5227066, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
4372024-06-28T20:18:33.781ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 92532127-cd27-4698-b4c3-8cafe5227066, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: InternalDns }, responder: ... }
4382024-06-28T20:18:33.830ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
4392024-06-28T20:18:33.830ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4402024-06-28T20:18:33.878ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7699ce21-4a72-4872-9082-389299b586d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
4412024-06-28T20:18:33.878ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 7699ce21-4a72-4872-9082-389299b586d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: InternalDns }, responder: ... }
4422024-06-28T20:18:33.927ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4432024-06-28T20:18:33.927ZINFOSledAgent (ServiceManager): No ledger in /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/omicron-zones.json file = common/src/ledger.rs:188
4442024-06-28T20:18:33.927ZINFOSledAgent (ServiceManager): No ledger in /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/omicron-zones.json file = common/src/ledger.rs:188
4452024-06-28T20:18:33.927ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4462024-06-28T20:18:33.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4472024-06-28T20:18:33.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4482024-06-28T20:18:33.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
4492024-06-28T20:18:33.984ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
4502024-06-28T20:18:34.001ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.098441197s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:390 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
4512024-06-28T20:18:34.022ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066 file = illumos-utils/src/zone.rs:315
4522024-06-28T20:18:34.026ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00 file = illumos-utils/src/zone.rs:315
4532024-06-28T20:18:34.030ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4 file = illumos-utils/src/zone.rs:315
4542024-06-28T20:18:34.043ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066 file = illumos-utils/src/zone.rs:354
4552024-06-28T20:18:34.047ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00 file = illumos-utils/src/zone.rs:354
4562024-06-28T20:18:34.051ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4 file = illumos-utils/src/zone.rs:354
4572024-06-28T20:18:34.728ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/nexus.rs:619 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
4582024-06-28T20:18:34.986ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6aa3805-f338-41a1-9087-e851abde3933): error trying to connect: dns error: proto error: io error: No route to host (os error 148) file = sled-agent/src/probe_manager.rs:171 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
4592024-06-28T20:18:35.560ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService1"/> <propval type="astring" name="gateway" value="fd00:1122:3344:1::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:1::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:1::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:1::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4602024-06-28T20:18:35.560ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
4612024-06-28T20:18:35.560ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
4622024-06-28T20:18:36.047ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService2"/> <propval type="astring" name="gateway" value="fd00:1122:3344:2::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:2::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:2::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:2::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4632024-06-28T20:18:36.528ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
4642024-06-28T20:18:36.528ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService3"/> <propval type="astring" name="gateway" value="fd00:1122:3344:3::2"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:3::1"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:3::1]:5353"/> <propval type="astring" name="dns_address" value="[fd00:1122:3344:3::1]:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
4652024-06-28T20:18:36.528ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
4662024-06-28T20:18:36.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066") failed: Property not found. retry in 67.24423ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
4672024-06-28T20:18:36.539ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
4682024-06-28T20:18:36.543ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4692024-06-28T20:18:36.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066") failed: Property not found. retry in 59.473173ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
4702024-06-28T20:18:36.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00") failed: Property not found. retry in 61.24566ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
4712024-06-28T20:18:36.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4") failed: Property not found. retry in 69.228309ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4722024-06-28T20:18:36.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066") failed: Property not found. retry in 184.091151ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
4732024-06-28T20:18:36.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00") failed: Property not found. retry in 90.075415ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
4742024-06-28T20:18:36.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4") failed: Property not found. retry in 78.675222ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4752024-06-28T20:18:37.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066") failed: Property not found. retry in 231.667502ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
4762024-06-28T20:18:37.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00") failed: Property not found. retry in 120.728263ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
4772024-06-28T20:18:37.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4") failed: Property not found. retry in 117.560868ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4782024-06-28T20:18:37.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00") failed: Property not found. retry in 592.242968ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
4792024-06-28T20:18:37.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4") failed: Property not found. retry in 538.830846ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4802024-06-28T20:18:37.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066") failed: Property not found. retry in 713.990953ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
4812024-06-28T20:18:37.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4") failed: Property not found. retry in 570.530139ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4822024-06-28T20:18:37.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00") failed: Property not found. retry in 619.31185ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
4832024-06-28T20:18:37.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066") failed: Property not found. retry in 1.02130793s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
4842024-06-28T20:18:38.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4") failed: Property not found. retry in 747.462011ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4852024-06-28T20:18:38.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00") failed: Property not found. retry in 1.171130158s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
4862024-06-28T20:18:39.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066") failed: Property not found. retry in 1.074164874s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
4872024-06-28T20:18:39.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4") failed: Property not found. retry in 786.883962ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4882024-06-28T20:18:39.428ZINFOSledAgent (ServiceManager): Ensuring bootstrap address fdb0:18c0:4d0d:a02a::2 exists in switch zone file = sled-agent/src/services.rs:2260
4892024-06-28T20:18:39.428ZINFOSledAgent (ServiceManager): Adding bootstrap address file = illumos-utils/src/running_zone.rs:626 zone = oxz_switch
4902024-06-28T20:18:39.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00") failed: Property not found. retry in 1.302631035s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
4912024-06-28T20:18:39.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4") failed: Property not found. retry in 861.9817ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4922024-06-28T20:18:39.976ZINFOSledAgent (ServiceManager): Forwarding bootstrap traffic via oxBootstrap0 to fe80::8:20ff:fe5c:996a file = sled-agent/src/services.rs:2267
4932024-06-28T20:18:39.981ZINFOSledAgent (ServiceManager): Zone not using gateway (even though underlay is up) file = sled-agent/src/services.rs:2328
4942024-06-28T20:18:40.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066") failed: Property not found. retry in 937.011588ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
4952024-06-28T20:18:40.100ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2513
4962024-06-28T20:18:40.342ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2677
4972024-06-28T20:18:40.534ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2392
4982024-06-28T20:18:40.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4") failed: Property not found. retry in 1.325841077s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
4992024-06-28T20:18:40.856ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2427
5002024-06-28T20:18:40.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00") failed: Property not found. retry in 1.100517118s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
5012024-06-28T20:18:41.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066") failed: Property not found. retry in 689.614383ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
5022024-06-28T20:18:41.074ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2727
5032024-06-28T20:18:41.249ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:2754
5042024-06-28T20:18:41.482ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2621
5052024-06-28T20:18:41.696ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2421
5062024-06-28T20:18:41.707ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:3813 new = [fd00:1122:3344:101::2, ::1] old = [::1]
5072024-06-28T20:18:41.707ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:3829
5082024-06-28T20:18:41.707ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:609 zone = oxz_switch
5092024-06-28T20:18:42.075ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_internal_dns_92532127-cd27-4698-b4c3-8cafe5227066
5102024-06-28T20:18:42.076ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_internal_dns_0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00
5112024-06-28T20:18:42.076ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_internal_dns_7699ce21-4a72-4872-9082-389299b586d4
5122024-06-28T20:18:42.076ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5132024-06-28T20:18:42.076ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
5142024-06-28T20:18:42.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8295634 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36642 req_id = 9c8c1bdf-334e-45ee-ad86-08015fcbbcdf response_code = 204 uri = /omicron-zones
5152024-06-28T20:18:42.078ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5162024-06-28T20:18:42.126ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 75.885751ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5172024-06-28T20:18:42.223ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5182024-06-28T20:18:42.282ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:3837
5192024-06-28T20:18:42.288ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:3893
5202024-06-28T20:18:42.418ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 63.895443ms) dns_config_addr = [fd00:1122:3344:2::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:2::1]:5353/config): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:569
5212024-06-28T20:18:42.420ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:3955
5222024-06-28T20:18:42.503ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:549
5232024-06-28T20:18:42.520ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:3936 rack_subnet = fd00:1122:3344::
5242024-06-28T20:18:42.543ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:3983
5252024-06-28T20:18:42.562ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:585
5262024-06-28T20:18:42.562ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
5272024-06-28T20:18:42.606ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
5282024-06-28T20:18:42.608ZWARNSledAgent (RSS): Failed to query MGS at fd00:1122:3344:101::2: Error Response: status: 503 Service Unavailable; headers: {"content-type": "application/json", "x-request-id": "302a1bc2-b9f6-43b4-adb2-d2709fa9574d", "content-length": "152", "date": "Fri, 28 Jun 2024 20:18:42 GMT"}; value: Error { error_code: Some("DiscoveryNotYetComplete"), message: "discovery process not yet complete", request_id: "302a1bc2-b9f6-43b4-adb2-d2709fa9574d" } file = sled-agent/src/bootstrap/early_networking.rs:309
5292024-06-28T20:18:42.608ZWARNSledAgent (RSS): Failed to look up switch zone locations error = No switch locations found file = sled-agent/src/bootstrap/early_networking.rs:232 retry_after = 127.930627ms
5302024-06-28T20:18:42.643ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4010
5312024-06-28T20:18:42.738ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
5322024-06-28T20:18:42.761ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:369
5332024-06-28T20:18:42.789ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
5342024-06-28T20:18:42.791ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
5352024-06-28T20:18:42.791ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
5362024-06-28T20:18:42.820ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:417
5372024-06-28T20:18:42.846ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 92532127-cd27-4698-b4c3-8cafe5227066, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7699ce21-4a72-4872-9082-389299b586d4, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: c6eb5117-102a-49a4-b407-0bea82d51b98, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f856e9a7-7a5e-4e2c-af31-389ec9c54a71, kind: Service { id: c6eb5117-102a-49a4-b407-0bea82d51b98 }, name: Name("ntp-c6eb5117-102a-49a4-b407-0bea82d51b98"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 126])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
5382024-06-28T20:18:42.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59314
5392024-06-28T20:18:42.847ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 92532127-cd27-4698-b4c3-8cafe5227066, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
5402024-06-28T20:18:42.847ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 92532127-cd27-4698-b4c3-8cafe5227066, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: InternalDns }, responder: ... }
5412024-06-28T20:18:42.867ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
5422024-06-28T20:18:42.867ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5432024-06-28T20:18:42.873ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:656
5442024-06-28T20:18:42.873ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:694
5452024-06-28T20:18:42.875ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:697 uptime = 2
5462024-06-28T20:18:42.875ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: None,\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:439
5472024-06-28T20:18:42.885ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7699ce21-4a72-4872-9082-389299b586d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
5482024-06-28T20:18:42.885ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 7699ce21-4a72-4872-9082-389299b586d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: InternalDns }, responder: ... }
5492024-06-28T20:18:42.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
5502024-06-28T20:18:42.905ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/omicron-zones.json file = common/src/ledger.rs:177
5512024-06-28T20:18:42.905ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/omicron-zones.json file = common/src/ledger.rs:177
5522024-06-28T20:18:42.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
5532024-06-28T20:18:42.916ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
5542024-06-28T20:18:42.962ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
5552024-06-28T20:18:42.964ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
5562024-06-28T20:18:42.964ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
5572024-06-28T20:18:42.966ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:406
5582024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5592024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
5602024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5612024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
5622024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5632024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
5642024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5652024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
5662024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5672024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
5682024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5692024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
5702024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5712024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
5722024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5732024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
5742024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5752024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
5762024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5772024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
5782024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:564 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5792024-06-28T20:18:42.966ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:585 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
5802024-06-28T20:18:43.010ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:478 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 240, 126]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 }, vnic: "vopte0" }) }
5812024-06-28T20:18:43.010ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1200 zone_type = ntp
5822024-06-28T20:18:43.011ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
5832024-06-28T20:18:43.011ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
5842024-06-28T20:18:43.011ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
5852024-06-28T20:18:43.013ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
5862024-06-28T20:18:43.037ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 file = illumos-utils/src/zone.rs:315
5872024-06-28T20:18:43.055ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98 file = illumos-utils/src/zone.rs:354
5882024-06-28T20:18:43.660ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService4"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value="fd00:1122:3344:100::/56"/> <propval type="boolean" name="boundary" value="true"/> <propval type="astring" name="server" value="0.pool.ntp.org"/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte0"/> <propval type="astring" name="gateway" value="172.30.3.1"/> <propval type="astring" name="ip" value="172.30.3.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
5892024-06-28T20:18:43.660ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
5902024-06-28T20:18:43.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98") failed: Property not found. retry in 42.112045ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
5912024-06-28T20:18:43.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98") failed: Property not found. retry in 71.142128ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
5922024-06-28T20:18:43.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98") failed: Property not found. retry in 221.902666ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
5932024-06-28T20:18:44.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98") failed: Property not found. retry in 527.56091ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
5942024-06-28T20:18:44.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98") failed: Property not found. retry in 1.013947742s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
5952024-06-28T20:18:45.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98") failed: Property not found. retry in 1.103069877s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
5962024-06-28T20:18:46.144ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55980
5972024-06-28T20:18:46.144ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 52 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55980 req_id = 6a7eb5a3-bafc-455a-b17e-4f42c550f4a6 response_code = 200 uri = /baseboard
5982024-06-28T20:18:46.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98") failed: Property not found. retry in 843.814605ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
5992024-06-28T20:18:47.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98") failed: Property not found. retry in 577.663239ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
6002024-06-28T20:18:48.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98") failed: Property not found. retry in 743.500621ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
6012024-06-28T20:18:49.027ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98
6022024-06-28T20:18:49.027ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6032024-06-28T20:18:49.028ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
6042024-06-28T20:18:49.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6181450 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59314 req_id = 3b5f4e28-7339-4d31-9bab-e38d2b994c45 response_code = 204 uri = /omicron-zones
6052024-06-28T20:18:49.030ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:626
6062024-06-28T20:18:49.058ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6072024-06-28T20:18:49.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34619
6082024-06-28T20:18:49.066ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3543
6092024-06-28T20:18:49.066ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 8218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34619 req_id = 948cf247-bbf1-465f-b8d0-3ff3a726dc8e response_code = 500 uri = /timesync
6102024-06-28T20:18:49.069ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6112024-06-28T20:18:49.168ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6122024-06-28T20:18:49.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55443
6132024-06-28T20:18:53.178ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3543
6142024-06-28T20:18:53.178ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4009826 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55443 req_id = 10907640-e766-4a97-a986-792f1a9fabb8 response_code = 500 uri = /timesync
6152024-06-28T20:18:53.182ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6162024-06-28T20:18:53.300ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6172024-06-28T20:18:53.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61462
6182024-06-28T20:18:53.309ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3543
6192024-06-28T20:18:53.309ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 8843 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61462 req_id = 4fe25e93-4136-4e88-8aa3-3deb3a4f37d3 response_code = 500 uri = /timesync
6202024-06-28T20:18:53.310ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6212024-06-28T20:18:53.494ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6222024-06-28T20:18:53.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46427
6232024-06-28T20:18:57.503ZINFOSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_c6eb5117-102a-49a4-b407-0bea82d51b98': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3543
6242024-06-28T20:18:57.503ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 4008938 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46427 req_id = 3bc06319-cd60-4930-b368-dbf4502bc79c response_code = 500 uri = /timesync
6252024-06-28T20:18:57.507ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6262024-06-28T20:18:57.725ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6272024-06-28T20:18:57.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65428
6282024-06-28T20:18:57.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7827 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65428 req_id = 106b1775-6e28-450e-8d9f-209c2d584b4a response_code = 200 uri = /timesync
6292024-06-28T20:18:57.737ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6302024-06-28T20:18:57.737ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6312024-06-28T20:18:58.076ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6322024-06-28T20:18:58.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40455
6332024-06-28T20:18:58.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7861 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40455 req_id = 418786aa-38dc-4b49-8bcc-3d90bc22cd45 response_code = 200 uri = /timesync
6342024-06-28T20:18:58.086ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6352024-06-28T20:18:58.086ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6362024-06-28T20:18:58.395ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6372024-06-28T20:18:58.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58602
6382024-06-28T20:18:58.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8075 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58602 req_id = dbce6e95-01d8-4306-9c80-99c4f73e1a31 response_code = 200 uri = /timesync
6392024-06-28T20:18:58.405ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6402024-06-28T20:18:58.405ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6412024-06-28T20:18:58.736ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6422024-06-28T20:18:58.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52464
6432024-06-28T20:18:58.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7860 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52464 req_id = 7cf93f6a-7c06-453b-ae37-f83c189c7326 response_code = 200 uri = /timesync
6442024-06-28T20:18:58.746ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6452024-06-28T20:18:58.746ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6462024-06-28T20:18:59.198ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6472024-06-28T20:18:59.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33014
6482024-06-28T20:18:59.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33014 req_id = 9e59a863-0509-4979-bc54-2cfe2103a3ce response_code = 200 uri = /timesync
6492024-06-28T20:18:59.208ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6502024-06-28T20:18:59.208ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6512024-06-28T20:18:59.536ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6522024-06-28T20:18:59.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38865
6532024-06-28T20:18:59.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38865 req_id = 43bccc14-334d-41bf-ad2f-34d9c7e6ecb1 response_code = 200 uri = /timesync
6542024-06-28T20:18:59.548ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6552024-06-28T20:18:59.548ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6562024-06-28T20:18:59.973ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6572024-06-28T20:18:59.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61603
6582024-06-28T20:18:59.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8023 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61603 req_id = b6004cd2-e9e0-45ce-85d6-23cb64f6fbee response_code = 200 uri = /timesync
6592024-06-28T20:18:59.984ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:634
6602024-06-28T20:18:59.984ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6612024-06-28T20:19:00.137ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 178.745859ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
6622024-06-28T20:19:00.832ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6632024-06-28T20:19:00.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36558
6642024-06-28T20:19:00.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8696 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36558 req_id = 4c9f2cd6-0463-4538-b60d-e1d7281d43a8 response_code = 200 uri = /timesync
6652024-06-28T20:19:00.843ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1719605938.993395, correction: 0.061296672 } file = sled-agent/src/rack_setup/service.rs:634
6662024-06-28T20:19:00.843ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6672024-06-28T20:19:01.757ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6682024-06-28T20:19:01.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49289
6692024-06-28T20:19:01.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 9124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49289 req_id = c11000b3-f9c1-47ec-8861-a7691e9c68d7 response_code = 200 uri = /timesync
6702024-06-28T20:19:01.769ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1719605938.993395, correction: 0.058799468 } file = sled-agent/src/rack_setup/service.rs:634
6712024-06-28T20:19:01.769ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6722024-06-28T20:19:03.131ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6732024-06-28T20:19:03.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53714
6742024-06-28T20:19:03.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8940 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53714 req_id = f30f5b9e-6512-49ce-8e4a-3c5e57cf60ef response_code = 200 uri = /timesync
6752024-06-28T20:19:03.142ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1719605941.4031932, correction: 0.05573744 } file = sled-agent/src/rack_setup/service.rs:634
6762024-06-28T20:19:03.142ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6772024-06-28T20:19:04.434ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6782024-06-28T20:19:04.434ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40513
6792024-06-28T20:19:04.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 8058 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40513 req_id = ad57ec95-fb2c-4c59-b6e9-b0ca820dac67 response_code = 200 uri = /timesync
6802024-06-28T20:19:04.445ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1719605941.4031932, correction: 0.052221082 } file = sled-agent/src/rack_setup/service.rs:634
6812024-06-28T20:19:04.445ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:656
6822024-06-28T20:19:05.258ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:606
6832024-06-28T20:19:05.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43805
6842024-06-28T20:19:05.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 20616 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43805 req_id = 95b40027-7e8e-41f8-add1-e423a1a0d782 response_code = 200 uri = /timesync
6852024-06-28T20:19:05.281ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2180654075, ip_addr: 129.250.35.251, stratum: 3, ref_time: 1719605941.4031932, correction: 0.049993228 } file = sled-agent/src/rack_setup/service.rs:634
6862024-06-28T20:19:05.281ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1224
6872024-06-28T20:19:05.309ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 92532127-cd27-4698-b4c3-8cafe5227066, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7699ce21-4a72-4872-9082-389299b586d4, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: c6eb5117-102a-49a4-b407-0bea82d51b98, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f856e9a7-7a5e-4e2c-af31-389ec9c54a71, kind: Service { id: c6eb5117-102a-49a4-b407-0bea82d51b98 }, name: Name("ntp-c6eb5117-102a-49a4-b407-0bea82d51b98"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 126])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3d52ebf0-9b27-48b4-9c90-165cf25b4825, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } } } }, OmicronZoneConfig { id: dddc2434-6762-4ce1-ae8d-3d886a9d4b0b, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 165c8e18-90df-4173-b967-df9cf4638077, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2ed80640-7c81-4661-9625-e46b28afb97f, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External } } } }, OmicronZoneConfig { id: a230e484-b94b-43b7-881b-507122f21af2, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
6882024-06-28T20:19:05.309ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62128
6892024-06-28T20:19:05.310ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 92532127-cd27-4698-b4c3-8cafe5227066, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
6902024-06-28T20:19:05.310ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 92532127-cd27-4698-b4c3-8cafe5227066, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6912024-06-28T20:19:05.330ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
6922024-06-28T20:19:05.330ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6932024-06-28T20:19:05.348ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7699ce21-4a72-4872-9082-389299b586d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
6942024-06-28T20:19:05.349ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 7699ce21-4a72-4872-9082-389299b586d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6952024-06-28T20:19:05.366ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3d52ebf0-9b27-48b4-9c90-165cf25b4825, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
6962024-06-28T20:19:05.366ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 3d52ebf0-9b27-48b4-9c90-165cf25b4825, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6972024-06-28T20:19:05.417ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: dddc2434-6762-4ce1-ae8d-3d886a9d4b0b, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
6982024-06-28T20:19:05.417ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: dddc2434-6762-4ce1-ae8d-3d886a9d4b0b, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
6992024-06-28T20:19:05.471ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 165c8e18-90df-4173-b967-df9cf4638077, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7002024-06-28T20:19:05.471ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 165c8e18-90df-4173-b967-df9cf4638077, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7012024-06-28T20:19:05.522ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2ed80640-7c81-4661-9625-e46b28afb97f, dataset_name: DatasetName { pool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7022024-06-28T20:19:05.522ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 2ed80640-7c81-4661-9625-e46b28afb97f, dataset_name: DatasetName { pool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7032024-06-28T20:19:05.573ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a230e484-b94b-43b7-881b-507122f21af2, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
7042024-06-28T20:19:05.573ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: a230e484-b94b-43b7-881b-507122f21af2, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
7052024-06-28T20:19:05.624ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7062024-06-28T20:19:05.624ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/omicron-zones.json file = common/src/ledger.rs:177
7072024-06-28T20:19:05.625ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/omicron-zones.json file = common/src/ledger.rs:177
7082024-06-28T20:19:05.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7092024-06-28T20:19:05.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7102024-06-28T20:19:05.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7112024-06-28T20:19:05.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7122024-06-28T20:19:05.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7132024-06-28T20:19:05.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
7142024-06-28T20:19:05.800ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077 file = illumos-utils/src/zone.rs:315
7152024-06-28T20:19:05.804ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825 file = illumos-utils/src/zone.rs:315
7162024-06-28T20:19:05.808ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b file = illumos-utils/src/zone.rs:315
7172024-06-28T20:19:05.813ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f file = illumos-utils/src/zone.rs:315
7182024-06-28T20:19:05.817ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2 file = illumos-utils/src/zone.rs:315
7192024-06-28T20:19:05.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077 file = illumos-utils/src/zone.rs:354
7202024-06-28T20:19:05.827ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825 file = illumos-utils/src/zone.rs:354
7212024-06-28T20:19:05.831ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b file = illumos-utils/src/zone.rs:354
7222024-06-28T20:19:05.835ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f file = illumos-utils/src/zone.rs:354
7232024-06-28T20:19:05.840ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2 file = illumos-utils/src/zone.rs:354
7242024-06-28T20:19:08.817ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService8"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="2ed80640-7c81-4661-9625-e46b28afb97f"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::6]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::6]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7252024-06-28T20:19:08.817ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7262024-06-28T20:19:08.823ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService6"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::3"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="3d52ebf0-9b27-48b4-9c90-165cf25b4825"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::3]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::3]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7272024-06-28T20:19:08.824ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7282024-06-28T20:19:08.869ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService5"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="165c8e18-90df-4173-b967-df9cf4638077"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::5]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::5]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7292024-06-28T20:19:08.869ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7302024-06-28T20:19:08.875ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService7"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::4"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="dddc2434-6762-4ce1-ae8d-3d886a9d4b0b"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::4]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::4]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7312024-06-28T20:19:08.876ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7322024-06-28T20:19:08.933ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService9"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value="a230e484-b94b-43b7-881b-507122f21af2"/> <propval type="astring" name="cockroach_address" value="[fd00:1122:3344:101::7]:32221"/> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::7]:32222"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7332024-06-28T20:19:08.933ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7342024-06-28T20:19:08.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 60.217051ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7352024-06-28T20:19:08.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 52.4731ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7362024-06-28T20:19:09.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 73.758787ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7372024-06-28T20:19:09.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 63.420361ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7382024-06-28T20:19:09.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 117.575975ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7392024-06-28T20:19:09.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 146.684265ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7402024-06-28T20:19:09.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 109.75542ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7412024-06-28T20:19:09.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 277.172228ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7422024-06-28T20:19:10.136ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 57.755253ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7432024-06-28T20:19:10.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 177.837856ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7442024-06-28T20:19:10.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 56.239369ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7452024-06-28T20:19:11.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 110.480806ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7462024-06-28T20:19:11.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 322.078296ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7472024-06-28T20:19:11.286ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 224.452114ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7482024-06-28T20:19:11.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 369.608715ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7492024-06-28T20:19:11.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 129.252645ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7502024-06-28T20:19:11.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 503.611895ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7512024-06-28T20:19:11.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 131.117185ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7522024-06-28T20:19:11.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 234.255716ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7532024-06-28T20:19:11.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 879.563212ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7542024-06-28T20:19:11.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 431.613903ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7552024-06-28T20:19:11.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 867.909051ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7562024-06-28T20:19:11.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 971.098007ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7572024-06-28T20:19:11.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 546.304946ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7582024-06-28T20:19:12.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 998.999911ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7592024-06-28T20:19:12.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 1.117111636s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7602024-06-28T20:19:12.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 1.404045102s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7612024-06-28T20:19:12.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 1.081576774s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7622024-06-28T20:19:12.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.404292022s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7632024-06-28T20:19:13.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 763.599683ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7642024-06-28T20:19:13.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 603.760416ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7652024-06-28T20:19:13.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 920.157021ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7662024-06-28T20:19:13.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 1.241742724s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7672024-06-28T20:19:13.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 1.242437268s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7682024-06-28T20:19:14.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 799.35647ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7692024-06-28T20:19:14.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.398483936s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7702024-06-28T20:19:14.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 627.511841ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7712024-06-28T20:19:14.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 1.387970012s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7722024-06-28T20:19:15.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 910.103752ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7732024-06-28T20:19:15.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 1.26161498s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7742024-06-28T20:19:15.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 1.241965055s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7752024-06-28T20:19:15.390ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 509.943312ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
7762024-06-28T20:19:15.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 790.74475ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7772024-06-28T20:19:16.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 840.061842ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7782024-06-28T20:19:16.217ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33425
7792024-06-28T20:19:16.218ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33425 req_id = ea10792e-c77f-41fb-970a-2f34435c85b0 response_code = 200 uri = /baseboard
7802024-06-28T20:19:16.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 830.587574ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7812024-06-28T20:19:16.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.426556961s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7822024-06-28T20:19:16.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 1.078905761s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7832024-06-28T20:19:16.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 1.15698705s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7842024-06-28T20:19:16.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 929.553544ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7852024-06-28T20:19:17.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 1.303243745s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7862024-06-28T20:19:17.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 836.099333ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7872024-06-28T20:19:17.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f") failed: Property not found. retry in 971.094189ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
7882024-06-28T20:19:17.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2") failed: Property not found. retry in 1.130841011s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
7892024-06-28T20:19:17.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.481459585s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7902024-06-28T20:19:18.338ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 1.379382579s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7912024-06-28T20:19:18.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 1.095179098s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7922024-06-28T20:19:19.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.221961991s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7932024-06-28T20:19:19.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 657.327731ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7942024-06-28T20:19:19.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 1.149510258s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7952024-06-28T20:19:20.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 920.090317ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7962024-06-28T20:19:20.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.09490462s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
7972024-06-28T20:19:21.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 909.476905ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
7982024-06-28T20:19:21.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 1.319710382s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
7992024-06-28T20:19:21.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.128917547s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
8002024-06-28T20:19:22.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 645.331382ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
8012024-06-28T20:19:22.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 867.159763ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
8022024-06-28T20:19:22.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 645.186769ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
8032024-06-28T20:19:22.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.050510957s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
8042024-06-28T20:19:23.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 1.130283172s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
8052024-06-28T20:19:23.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 894.342564ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
8062024-06-28T20:19:23.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 786.440406ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
8072024-06-28T20:19:24.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 1.469654889s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
8082024-06-28T20:19:24.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 882.825952ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
8092024-06-28T20:19:24.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.167909771s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
8102024-06-28T20:19:25.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 981.249965ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
8112024-06-28T20:19:25.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 1.270036136s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
8122024-06-28T20:19:25.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 967.832476ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
8132024-06-28T20:19:26.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 1.279682744s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
8142024-06-28T20:19:26.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 781.986313ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
8152024-06-28T20:19:27.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 654.023945ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
8162024-06-28T20:19:27.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b") failed: Property not found. retry in 1.168215924s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
8172024-06-28T20:19:27.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825") failed: Property not found. retry in 1.065911925s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
8182024-06-28T20:19:27.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077") failed: Property not found. retry in 745.523937ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
8192024-06-28T20:19:28.813ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077
8202024-06-28T20:19:28.813ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_cockroachdb_3d52ebf0-9b27-48b4-9c90-165cf25b4825
8212024-06-28T20:19:28.813ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_cockroachdb_dddc2434-6762-4ce1-ae8d-3d886a9d4b0b
8222024-06-28T20:19:28.813ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_cockroachdb_2ed80640-7c81-4661-9625-e46b28afb97f
8232024-06-28T20:19:28.813ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_cockroachdb_a230e484-b94b-43b7-881b-507122f21af2
8242024-06-28T20:19:28.813ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8252024-06-28T20:19:28.813ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8262024-06-28T20:19:28.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 23453168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62128 req_id = 895c5e01-65a8-4d45-b259-c103afc4245e response_code = 204 uri = /omicron-zones
8272024-06-28T20:19:28.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34176
8282024-06-28T20:19:28.872ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27058 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:34176 req_id = 6d1eea7c-dab1-4849-93f5-5fefc6c02a76 response_code = 500 uri = /cockroachdb
8292024-06-28T20:19:28.872ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6d1eea7c-dab1-4849-93f5-5fefc6c02a76", "content-length": "124", "date": "Fri, 28 Jun 2024 20:19:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6d1eea7c-dab1-4849-93f5-5fefc6c02a76" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 115.376511ms
8302024-06-28T20:19:29.015ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_165c8e18-90df-4173-b967-df9cf4638077 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Address object not found file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:866 latency_us = 27071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:34176 req_id = 675a0922-81f2-4bf8-8ac1-eaf4029e998a response_code = 500 uri = /cockroachdb
8312024-06-28T20:19:29.016ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "675a0922-81f2-4bf8-8ac1-eaf4029e998a", "content-length": "124", "date": "Fri, 28 Jun 2024 20:19:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "675a0922-81f2-4bf8-8ac1-eaf4029e998a" } file = sled-agent/src/rack_setup/service.rs:966 retry_after = 127.986101ms
8322024-06-28T20:19:29.173ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3377
8332024-06-28T20:19:41.264ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3395
8342024-06-28T20:19:50.469ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3418
8352024-06-28T20:19:50.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 21324970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:34176 req_id = 42c7f1fc-bc78-462b-9fd9-daae21c42767 response_code = 204 uri = /cockroachdb
8362024-06-28T20:19:50.470ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50447
8372024-06-28T20:19:50.471ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 277 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50447 req_id = 53b585b3-4444-47b1-9cab-5539a9ddd18f response_code = 200 uri = /baseboard
8382024-06-28T20:19:50.479ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.263097187s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
8392024-06-28T20:19:50.510ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 92532127-cd27-4698-b4c3-8cafe5227066, underlay_address: fd00:1122:3344:1::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, underlay_address: fd00:1122:3344:2::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 7699ce21-4a72-4872-9082-389299b586d4, underlay_address: fd00:1122:3344:3::1, zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: c6eb5117-102a-49a4-b407-0bea82d51b98, underlay_address: fd00:1122:3344:101::1b, zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: f856e9a7-7a5e-4e2c-af31-389ec9c54a71, kind: Service { id: c6eb5117-102a-49a4-b407-0bea82d51b98 }, name: Name("ntp-c6eb5117-102a-49a4-b407-0bea82d51b98"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 126])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 3d52ebf0-9b27-48b4-9c90-165cf25b4825, underlay_address: fd00:1122:3344:101::3, zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } } } }, OmicronZoneConfig { id: dddc2434-6762-4ce1-ae8d-3d886a9d4b0b, underlay_address: fd00:1122:3344:101::4, zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 165c8e18-90df-4173-b967-df9cf4638077, underlay_address: fd00:1122:3344:101::5, zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2ed80640-7c81-4661-9625-e46b28afb97f, underlay_address: fd00:1122:3344:101::6, zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External } } } }, OmicronZoneConfig { id: a230e484-b94b-43b7-881b-507122f21af2, underlay_address: fd00:1122:3344:101::7, zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External } } } }, OmicronZoneConfig { id: af471492-15f5-4f5e-8e86-1a6f5fed1194, underlay_address: fd00:1122:3344:101::8, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 4a25946c-409b-4dd7-b387-5787a229c6cd, kind: Service { id: af471492-15f5-4f5e-8e86-1a6f5fed1194 }, name: Name("external-dns-af471492-15f5-4f5e-8e86-1a6f5fed1194"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 822a6774-7180-42fa-b51d-f435fb7cb390, underlay_address: fd00:1122:3344:101::9, zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 3784a80e-4ca5-4f13-872e-b0c3f0386cb2, kind: Service { id: 822a6774-7180-42fa-b51d-f435fb7cb390 }, name: Name("external-dns-822a6774-7180-42fa-b51d-f435fb7cb390"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 6f5d9265-ef8a-4911-9c83-53b3e7aa91b8, underlay_address: fd00:1122:3344:101::a, zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: fa47896d-e04d-4f67-8af5-28d86a4805bb, kind: Service { id: 6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 }, name: Name("nexus-6f5d9265-ef8a-4911-9c83-53b3e7aa91b8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d, underlay_address: fd00:1122:3344:101::b, zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 36efc940-600c-4377-bde8-924b208bd6df, kind: Service { id: 2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d }, name: Name("nexus-2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a, underlay_address: fd00:1122:3344:101::c, zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: a68d6849-d9e0-466b-ac4f-07da426a0fcd, kind: Service { id: 106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a }, name: Name("nexus-106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 0391f077-b9a1-4844-9e70-a95bfc8b9476, underlay_address: fd00:1122:3344:101::d, zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: e6272ee2-d571-4677-b748-3ad2a6571d0c, underlay_address: fd00:1122:3344:101::e, zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } } } }, OmicronZoneConfig { id: c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774, underlay_address: fd00:1122:3344:101::f, zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3, underlay_address: fd00:1122:3344:101::10, zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 8cd26a24-e179-4c2b-8ef0-2266755e71bc, underlay_address: fd00:1122:3344:101::11, zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: d833112f-3a6f-42df-ac2b-4b363ae18dec, underlay_address: fd00:1122:3344:101::12, zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External } } } }, OmicronZoneConfig { id: 6fc0d54c-41e9-4485-919d-d85a89e9ab33, underlay_address: fd00:1122:3344:101::13, zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4d13a6af-add8-4650-88b0-7d15ba1f163d, underlay_address: fd00:1122:3344:101::14, zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External } } } }, OmicronZoneConfig { id: d9867757-ac46-4856-aef2-786b23e9ebfc, underlay_address: fd00:1122:3344:101::15, zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6fedf47d-3180-423a-8b74-f67b2ef9bc36, underlay_address: fd00:1122:3344:101::16, zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External } } } }, OmicronZoneConfig { id: 380a17ba-30f9-40ef-bba1-dae624407a8a, underlay_address: fd00:1122:3344:101::17, zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ddccf8a3-466c-4983-9045-85a61a2f0cb5 (zpool), kind: External } } } }, OmicronZoneConfig { id: f76fcb75-ac1f-4991-a5d4-8220da27a83e, underlay_address: fd00:1122:3344:101::18, zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 70d817e0-8838-4d86-ae6d-cb77ce8a3e35 (zpool), kind: External } } } }, OmicronZoneConfig { id: a46ed8b8-c687-449d-94f8-3ba05af89482, underlay_address: fd00:1122:3344:101::19, zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11 (zpool), kind: External } } } }, OmicronZoneConfig { id: a63c36c6-a325-485c-9ccb-7977dbb9a573, underlay_address: fd00:1122:3344:101::1a, zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b1b0311e-24a0-4d3f-b298-78dc98cee0a2 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:431 sled_address = [fd00:1122:3344:101::1]:12345
8402024-06-28T20:19:50.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39280
8412024-06-28T20:19:50.513ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 92532127-cd27-4698-b4c3-8cafe5227066, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8422024-06-28T20:19:50.516ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 92532127-cd27-4698-b4c3-8cafe5227066, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: InternalDns }, responder: ... }
8432024-06-28T20:19:50.536ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8442024-06-28T20:19:50.537ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 0e4b7f2b-6a76-4bb0-957c-eaa6e1a83c00, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8452024-06-28T20:19:50.556ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 7699ce21-4a72-4872-9082-389299b586d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8462024-06-28T20:19:50.556ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 7699ce21-4a72-4872-9082-389299b586d4, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8472024-06-28T20:19:50.575ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3d52ebf0-9b27-48b4-9c90-165cf25b4825, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8482024-06-28T20:19:50.575ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 3d52ebf0-9b27-48b4-9c90-165cf25b4825, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8492024-06-28T20:19:50.593ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: dddc2434-6762-4ce1-ae8d-3d886a9d4b0b, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8502024-06-28T20:19:50.593ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: dddc2434-6762-4ce1-ae8d-3d886a9d4b0b, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8512024-06-28T20:19:50.611ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 165c8e18-90df-4173-b967-df9cf4638077, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8522024-06-28T20:19:50.611ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 165c8e18-90df-4173-b967-df9cf4638077, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8532024-06-28T20:19:50.630ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2ed80640-7c81-4661-9625-e46b28afb97f, dataset_name: DatasetName { pool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8542024-06-28T20:19:50.630ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 2ed80640-7c81-4661-9625-e46b28afb97f, dataset_name: DatasetName { pool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8552024-06-28T20:19:50.650ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a230e484-b94b-43b7-881b-507122f21af2, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External }, kind: CockroachDb }, responder: ... }) file = sled-storage/src/manager.rs:406
8562024-06-28T20:19:50.650ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: a230e484-b94b-43b7-881b-507122f21af2, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External }, kind: CockroachDb }, responder: ... }
8572024-06-28T20:19:50.668ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: af471492-15f5-4f5e-8e86-1a6f5fed1194, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8582024-06-28T20:19:50.668ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: af471492-15f5-4f5e-8e86-1a6f5fed1194, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8592024-06-28T20:19:50.791ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 822a6774-7180-42fa-b51d-f435fb7cb390, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:406
8602024-06-28T20:19:50.791ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 822a6774-7180-42fa-b51d-f435fb7cb390, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
8612024-06-28T20:19:50.921ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e6272ee2-d571-4677-b748-3ad2a6571d0c, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:406
8622024-06-28T20:19:50.921ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: e6272ee2-d571-4677-b748-3ad2a6571d0c, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: Clickhouse }, responder: ... }
8632024-06-28T20:19:51.070ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d833112f-3a6f-42df-ac2b-4b363ae18dec, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8642024-06-28T20:19:51.070ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: d833112f-3a6f-42df-ac2b-4b363ae18dec, dataset_name: DatasetName { pool_name: ZpoolName { id: 5ac4a919-8b24-423d-ad25-5b564847ba3f (zpool), kind: External }, kind: Crucible }, responder: ... }
8652024-06-28T20:19:51.169ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6fc0d54c-41e9-4485-919d-d85a89e9ab33, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8662024-06-28T20:19:51.169ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 6fc0d54c-41e9-4485-919d-d85a89e9ab33, dataset_name: DatasetName { pool_name: ZpoolName { id: e2ec5a14-af67-4734-9131-7da5563a61e7 (zpool), kind: External }, kind: Crucible }, responder: ... }
8672024-06-28T20:19:51.269ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 4d13a6af-add8-4650-88b0-7d15ba1f163d, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8682024-06-28T20:19:51.269ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 4d13a6af-add8-4650-88b0-7d15ba1f163d, dataset_name: DatasetName { pool_name: ZpoolName { id: d4198ec9-f3b5-46ff-8674-42aeb9de5463 (zpool), kind: External }, kind: Crucible }, responder: ... }
8692024-06-28T20:19:51.391ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d9867757-ac46-4856-aef2-786b23e9ebfc, dataset_name: DatasetName { pool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8702024-06-28T20:19:51.391ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: d9867757-ac46-4856-aef2-786b23e9ebfc, dataset_name: DatasetName { pool_name: ZpoolName { id: c1542ec6-6c29-4611-9b23-92e37a62d021 (zpool), kind: External }, kind: Crucible }, responder: ... }
8712024-06-28T20:19:51.494ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 6fedf47d-3180-423a-8b74-f67b2ef9bc36, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8722024-06-28T20:19:51.494ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 6fedf47d-3180-423a-8b74-f67b2ef9bc36, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3016d5-07c4-4b1e-9f22-6b003745d806 (zpool), kind: External }, kind: Crucible }, responder: ... }
8732024-06-28T20:19:51.595ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 380a17ba-30f9-40ef-bba1-dae624407a8a, dataset_name: DatasetName { pool_name: ZpoolName { id: ddccf8a3-466c-4983-9045-85a61a2f0cb5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8742024-06-28T20:19:51.595ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: 380a17ba-30f9-40ef-bba1-dae624407a8a, dataset_name: DatasetName { pool_name: ZpoolName { id: ddccf8a3-466c-4983-9045-85a61a2f0cb5 (zpool), kind: External }, kind: Crucible }, responder: ... }
8752024-06-28T20:19:51.700ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: f76fcb75-ac1f-4991-a5d4-8220da27a83e, dataset_name: DatasetName { pool_name: ZpoolName { id: 70d817e0-8838-4d86-ae6d-cb77ce8a3e35 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8762024-06-28T20:19:51.700ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: f76fcb75-ac1f-4991-a5d4-8220da27a83e, dataset_name: DatasetName { pool_name: ZpoolName { id: 70d817e0-8838-4d86-ae6d-cb77ce8a3e35 (zpool), kind: External }, kind: Crucible }, responder: ... }
8772024-06-28T20:19:51.792ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a46ed8b8-c687-449d-94f8-3ba05af89482, dataset_name: DatasetName { pool_name: ZpoolName { id: 6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8782024-06-28T20:19:51.792ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: a46ed8b8-c687-449d-94f8-3ba05af89482, dataset_name: DatasetName { pool_name: ZpoolName { id: 6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11 (zpool), kind: External }, kind: Crucible }, responder: ... }
8792024-06-28T20:19:51.887ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: a63c36c6-a325-485c-9ccb-7977dbb9a573, dataset_name: DatasetName { pool_name: ZpoolName { id: b1b0311e-24a0-4d3f-b298-78dc98cee0a2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:406
8802024-06-28T20:19:51.887ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:853 request = NewFilesystemRequest { dataset_id: a63c36c6-a325-485c-9ccb-7977dbb9a573, dataset_name: DatasetName { pool_name: ZpoolName { id: b1b0311e-24a0-4d3f-b298-78dc98cee0a2 (zpool), kind: External }, kind: Crucible }, responder: ... }
8812024-06-28T20:19:51.969ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8822024-06-28T20:19:51.969ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/omicron-zones.json file = common/src/ledger.rs:177
8832024-06-28T20:19:51.970ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/omicron-zones.json file = common/src/ledger.rs:177
8842024-06-28T20:19:51.970ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8852024-06-28T20:19:52.081ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
8862024-06-28T20:19:52.096ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
8872024-06-28T20:19:52.097ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8882024-06-28T20:19:52.099ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
8892024-06-28T20:19:52.099ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8902024-06-28T20:19:52.158ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8912024-06-28T20:19:52.158ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8922024-06-28T20:19:52.158ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8932024-06-28T20:19:52.158ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8942024-06-28T20:19:52.158ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8952024-06-28T20:19:52.322ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
8962024-06-28T20:19:52.323ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8972024-06-28T20:19:52.323ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8982024-06-28T20:19:52.323ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
8992024-06-28T20:19:52.373ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:263
9002024-06-28T20:19:52.374ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9012024-06-28T20:19:52.374ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9022024-06-28T20:19:52.374ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9032024-06-28T20:19:52.374ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9042024-06-28T20:19:52.374ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774 file = illumos-utils/src/zone.rs:315
9052024-06-28T20:19:52.380ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc file = illumos-utils/src/zone.rs:315
9062024-06-28T20:19:52.386ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec file = illumos-utils/src/zone.rs:315
9072024-06-28T20:19:52.390ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc file = illumos-utils/src/zone.rs:315
9082024-06-28T20:19:52.396ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a file = illumos-utils/src/zone.rs:315
9092024-06-28T20:19:52.401ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476 file = illumos-utils/src/zone.rs:315
9102024-06-28T20:19:52.406ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d file = illumos-utils/src/zone.rs:315
9112024-06-28T20:19:52.549ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774 file = illumos-utils/src/zone.rs:354
9122024-06-28T20:19:52.554ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc file = illumos-utils/src/zone.rs:354
9132024-06-28T20:19:52.558ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec file = illumos-utils/src/zone.rs:354
9142024-06-28T20:19:52.565ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc file = illumos-utils/src/zone.rs:354
9152024-06-28T20:19:52.570ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a file = illumos-utils/src/zone.rs:354
9162024-06-28T20:19:52.575ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476 file = illumos-utils/src/zone.rs:354
9172024-06-28T20:19:52.580ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d file = illumos-utils/src/zone.rs:354
9182024-06-28T20:19:52.585ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c file = illumos-utils/src/zone.rs:315
9192024-06-28T20:19:52.590ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36 file = illumos-utils/src/zone.rs:315
9202024-06-28T20:19:52.595ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e file = illumos-utils/src/zone.rs:315
9212024-06-28T20:19:52.601ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3 file = illumos-utils/src/zone.rs:315
9222024-06-28T20:19:52.606ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482 file = illumos-utils/src/zone.rs:315
9232024-06-28T20:19:52.611ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573 file = illumos-utils/src/zone.rs:315
9242024-06-28T20:19:52.617ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33 file = illumos-utils/src/zone.rs:315
9252024-06-28T20:19:52.624ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c file = illumos-utils/src/zone.rs:354
9262024-06-28T20:19:52.630ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36 file = illumos-utils/src/zone.rs:354
9272024-06-28T20:19:52.636ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e file = illumos-utils/src/zone.rs:354
9282024-06-28T20:19:52.642ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3 file = illumos-utils/src/zone.rs:354
9292024-06-28T20:19:52.647ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482 file = illumos-utils/src/zone.rs:354
9302024-06-28T20:19:52.652ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573 file = illumos-utils/src/zone.rs:354
9312024-06-28T20:19:52.657ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33 file = illumos-utils/src/zone.rs:354
9322024-06-28T20:19:52.704ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9332024-06-28T20:19:52.763ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9342024-06-28T20:19:52.811ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9352024-06-28T20:19:52.871ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9362024-06-28T20:19:52.929ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:280
9372024-06-28T20:19:52.931ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9382024-06-28T20:19:52.931ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9392024-06-28T20:19:53.027ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:478 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 181, 216]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte1" }) }
9402024-06-28T20:19:53.027ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1200 zone_type = nexus
9412024-06-28T20:19:53.033ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9422024-06-28T20:19:53.033ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9432024-06-28T20:19:53.134ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:478 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 229, 220]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte2" }) }
9442024-06-28T20:19:53.134ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1200 zone_type = external_dns
9452024-06-28T20:19:53.137ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9462024-06-28T20:19:53.137ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9472024-06-28T20:19:53.234ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:478 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 255, 126]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte3" }) }
9482024-06-28T20:19:53.234ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1200 zone_type = nexus
9492024-06-28T20:19:53.237ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9502024-06-28T20:19:53.237ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9512024-06-28T20:19:53.332ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:478 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 222, 96]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 }, vnic: "vopte4" }) }
9522024-06-28T20:19:53.332ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1200 zone_type = nexus
9532024-06-28T20:19:53.335ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:305
9542024-06-28T20:19:53.335ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:197
9552024-06-28T20:19:53.424ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:478 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 214, 48]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 }, vnic: "vopte5" }) }
9562024-06-28T20:19:53.424ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1200 zone_type = external_dns
9572024-06-28T20:19:53.424ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
9582024-06-28T20:19:53.424ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
9592024-06-28T20:19:53.424ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
9602024-06-28T20:19:53.424ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
9612024-06-28T20:19:53.436ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
9622024-06-28T20:19:53.438ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9632024-06-28T20:19:53.483ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
9642024-06-28T20:19:53.483ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
9652024-06-28T20:19:53.483ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
9662024-06-28T20:19:53.483ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
9672024-06-28T20:19:53.483ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
9682024-06-28T20:19:53.483ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
9692024-06-28T20:19:53.484ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
9702024-06-28T20:19:53.487ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
9712024-06-28T20:19:53.490ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
9722024-06-28T20:19:53.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9732024-06-28T20:19:53.490ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9742024-06-28T20:19:53.493ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
9752024-06-28T20:19:53.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9762024-06-28T20:19:53.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
9772024-06-28T20:19:53.536ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194 file = illumos-utils/src/zone.rs:315
9782024-06-28T20:19:53.668ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a file = illumos-utils/src/zone.rs:315
9792024-06-28T20:19:53.676ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194 file = illumos-utils/src/zone.rs:354
9802024-06-28T20:19:53.685ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d file = illumos-utils/src/zone.rs:315
9812024-06-28T20:19:53.699ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 file = illumos-utils/src/zone.rs:315
9822024-06-28T20:19:53.707ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390 file = illumos-utils/src/zone.rs:315
9832024-06-28T20:19:53.716ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a file = illumos-utils/src/zone.rs:354
9842024-06-28T20:19:53.727ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d file = illumos-utils/src/zone.rs:354
9852024-06-28T20:19:53.740ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 file = illumos-utils/src/zone.rs:354
9862024-06-28T20:19:53.750ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390 file = illumos-utils/src/zone.rs:354
9872024-06-28T20:19:55.602ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService11"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::11"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::11"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9882024-06-28T20:19:55.632ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
9892024-06-28T20:19:55.661ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService20"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::10"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::10"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9902024-06-28T20:19:55.662ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
9912024-06-28T20:19:55.674ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService10"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::f"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::f"/> <propval type="astring" name="listen_port" value="17000"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9922024-06-28T20:19:55.676ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
9932024-06-28T20:19:55.781ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService16"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::14"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_d4198ec9-f3b5-46ff-8674-42aeb9de5463/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::14"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="ec12f433-7563-41ea-8bc0-77ffb4ceca38"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9942024-06-28T20:19:55.781ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
9952024-06-28T20:19:55.806ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService22"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::1a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1a"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="e3da42f8-c3fa-45f5-a85a-fc8a3998ddc4"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9962024-06-28T20:19:55.807ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService14"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::17"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_ddccf8a3-466c-4983-9045-85a61a2f0cb5/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::17"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="7f18cb0a-efbc-487e-bcb0-835c1cb499c7"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9972024-06-28T20:19:55.807ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
9982024-06-28T20:19:55.814ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
9992024-06-28T20:19:55.822ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService23"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::13"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_e2ec5a14-af67-4734-9131-7da5563a61e7/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::13"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="4ccee121-5d16-43a7-8338-8f7890036afd"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10002024-06-28T20:19:55.822ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
10012024-06-28T20:19:55.834ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService19"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::18"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::18"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="b0d99a6c-82b5-4d7d-aeb4-e9a6f9406948"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10022024-06-28T20:19:55.834ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService21"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::19"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::19"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="d957bb21-930f-4132-9e06-dc6ce0cde578"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10032024-06-28T20:19:55.834ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
10042024-06-28T20:19:55.842ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
10052024-06-28T20:19:55.900ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService13"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::15"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_c1542ec6-6c29-4611-9b23-92e37a62d021/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::15"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="665b78c0-0a53-4f6c-99cf-9a2500fb2706"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10062024-06-28T20:19:55.901ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
10072024-06-28T20:19:55.923ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService18"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::16"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_fd3016d5-07c4-4b1e-9f22-6b003745d806/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::16"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="87ab3e4e-1485-49b6-86de-263eba69df7f"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10082024-06-28T20:19:55.923ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
10092024-06-28T20:19:55.945ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService12"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::12"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value="oxp_5ac4a919-8b24-423d-ad25-5b564847ba3f/crucible"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::12"/> <propval type="astring" name="listen_port" value="32345"/> <propval type="astring" name="uuid" value="38c1d774-8e67-4256-89d7-a1ff1305dae2"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10102024-06-28T20:19:55.945ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
10112024-06-28T20:19:55.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 32.713057ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
10122024-06-28T20:19:56.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 35.526404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
10132024-06-28T20:19:56.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 50.328838ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
10142024-06-28T20:19:56.027ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService15"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::d"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value="0391f077-b9a1-4844-9e70-a95bfc8b9476"/> <propval type="astring" name="address" value="[fd00:1122:3344:101::d]:12223"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10152024-06-28T20:19:56.027ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
10162024-06-28T20:19:56.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 138.207411ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
10172024-06-28T20:19:56.065ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 120.621038ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
10182024-06-28T20:19:56.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 71.604687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
10192024-06-28T20:19:56.227ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 48.035927ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
10202024-06-28T20:19:56.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 56.739661ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
10212024-06-28T20:19:56.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 32.950421ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
10222024-06-28T20:19:56.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 291.620932ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
10232024-06-28T20:19:56.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 293.714587ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
10242024-06-28T20:19:56.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 110.789733ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
10252024-06-28T20:19:56.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 127.714857ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
10262024-06-28T20:19:56.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 46.91944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
10272024-06-28T20:19:56.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 265.364107ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
10282024-06-28T20:19:56.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 46.241687ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
10292024-06-28T20:19:56.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 109.708575ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
10302024-06-28T20:19:56.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 32.701812ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
10312024-06-28T20:19:56.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 440.954067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
10322024-06-28T20:19:56.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 303.524966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
10332024-06-28T20:19:56.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 30.229267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
10342024-06-28T20:19:57.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 47.431454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
10352024-06-28T20:19:57.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 105.439955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
10362024-06-28T20:19:57.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 57.866382ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
10372024-06-28T20:19:59.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 285.906127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
10382024-06-28T20:19:59.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 72.347247ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
10392024-06-28T20:19:59.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 72.079033ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
10402024-06-28T20:19:59.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 570.719999ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
10412024-06-28T20:19:59.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 148.814487ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
10422024-06-28T20:20:00.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 186.942769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
10432024-06-28T20:20:00.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 51.569535ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
10442024-06-28T20:20:00.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.150721532s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
10452024-06-28T20:20:00.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 400.142204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
10462024-06-28T20:20:00.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 118.612147ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
10472024-06-28T20:20:00.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 107.243605ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
10482024-06-28T20:20:00.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 236.691431ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
10492024-06-28T20:20:00.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 103.347194ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
10502024-06-28T20:20:00.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 278.000138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
10512024-06-28T20:20:00.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 51.782051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
10522024-06-28T20:20:00.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 210.67816ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
10532024-06-28T20:20:00.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 210.308196ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
10542024-06-28T20:20:00.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 120.248758ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
10552024-06-28T20:20:00.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 144.251228ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
10562024-06-28T20:20:00.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 124.52369ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
10572024-06-28T20:20:00.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 268.496106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
10582024-06-28T20:20:00.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 244.516454ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
10592024-06-28T20:20:00.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 116.478016ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
10602024-06-28T20:20:00.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 233.163004ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
10612024-06-28T20:20:00.314ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService24"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::8"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte2"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::8]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.5:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10622024-06-28T20:20:00.314ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService28"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::9"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte5"/> <propval type="astring" name="gateway" value="172.30.1.1"/> <propval type="astring" name="ip" value="172.30.1.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value="[fd00:1122:3344:101::9]:5353"/> <propval type="astring" name="dns_address" value="172.30.1.6:53"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10632024-06-28T20:20:00.315ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
10642024-06-28T20:20:00.321ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
10652024-06-28T20:20:00.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 1.090564807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
10662024-06-28T20:20:00.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 305.201331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
10672024-06-28T20:20:00.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 344.612114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
10682024-06-28T20:20:00.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 211.18724ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
10692024-06-28T20:20:00.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 499.479532ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
10702024-06-28T20:20:00.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 303.857928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
10712024-06-28T20:20:00.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 485.705069ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
10722024-06-28T20:20:00.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 986.259239ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
10732024-06-28T20:20:00.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 525.327631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
10742024-06-28T20:20:00.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 441.698907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
10752024-06-28T20:20:00.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 792.962309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
10762024-06-28T20:20:00.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.058292379s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
10772024-06-28T20:20:00.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 33.391708ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
10782024-06-28T20:20:00.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 43.879861ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
10792024-06-28T20:20:00.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.014330746s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
10802024-06-28T20:20:00.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 70.592229ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
10812024-06-28T20:20:00.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 129.203502ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
10822024-06-28T20:20:00.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 474.32728ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
10832024-06-28T20:20:00.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 200.01782ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
10842024-06-28T20:20:00.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 803.700049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
10852024-06-28T20:20:00.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.12156632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
10862024-06-28T20:20:00.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 229.994005ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
10872024-06-28T20:20:00.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 802.483821ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
10882024-06-28T20:20:00.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 557.644159ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
10892024-06-28T20:20:00.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 564.088271ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
10902024-06-28T20:20:00.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 664.695289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
10912024-06-28T20:20:01.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 661.168923ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
10922024-06-28T20:20:01.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 215.052139ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
10932024-06-28T20:20:01.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 554.131929ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
10942024-06-28T20:20:01.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.202695516s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
10952024-06-28T20:20:01.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 926.592529ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
10962024-06-28T20:20:01.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 1.456464955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
10972024-06-28T20:20:01.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 1.146795693s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
10982024-06-28T20:20:01.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.187271193s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
10992024-06-28T20:20:01.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 763.286443ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
11002024-06-28T20:20:01.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.270093534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
11012024-06-28T20:20:01.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 868.596447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
11022024-06-28T20:20:01.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 560.719536ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
11032024-06-28T20:20:01.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.006096484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
11042024-06-28T20:20:01.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.390290146s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
11052024-06-28T20:20:01.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 1.450624371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
11062024-06-28T20:20:01.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 662.458745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
11072024-06-28T20:20:01.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 780.629621ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
11082024-06-28T20:20:01.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.032944131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
11092024-06-28T20:20:02.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.215058749s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
11102024-06-28T20:20:02.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 1.041457612s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
11112024-06-28T20:20:02.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 627.042306ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
11122024-06-28T20:20:02.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 503.58031ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
11132024-06-28T20:20:02.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.094201667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
11142024-06-28T20:20:02.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.482992628s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
11152024-06-28T20:20:02.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 1.330133789s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
11162024-06-28T20:20:02.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 599.459568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
11172024-06-28T20:20:02.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.273114805s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
11182024-06-28T20:20:02.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.447232857s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
11192024-06-28T20:20:02.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.372356622s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
11202024-06-28T20:20:02.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 1.150654732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
11212024-06-28T20:20:02.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 748.309982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
11222024-06-28T20:20:02.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.253043948s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
11232024-06-28T20:20:02.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.205680319s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
11242024-06-28T20:20:03.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 830.563378ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
11252024-06-28T20:20:03.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 829.282442ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
11262024-06-28T20:20:03.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 624.754987ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
11272024-06-28T20:20:03.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 1.25180365s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
11282024-06-28T20:20:03.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.148925222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
11292024-06-28T20:20:03.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.412290641s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
11302024-06-28T20:20:03.663ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService25"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::c"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte1"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.7"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11312024-06-28T20:20:03.663ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService26"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::b"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte3"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.6"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11322024-06-28T20:20:03.663ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
11332024-06-28T20:20:03.671ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
11342024-06-28T20:20:03.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.17510807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
11352024-06-28T20:20:03.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.064865336s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
11362024-06-28T20:20:03.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 30.18768ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
11372024-06-28T20:20:03.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.461592472s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
11382024-06-28T20:20:03.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 72.612691ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
11392024-06-28T20:20:03.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 520.31242ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
11402024-06-28T20:20:03.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 742.106093ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
11412024-06-28T20:20:04.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 903.588757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
11422024-06-28T20:20:04.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 762.068435ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
11432024-06-28T20:20:04.044ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 589.205874ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
11442024-06-28T20:20:04.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 240.645056ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
11452024-06-28T20:20:04.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 27.682523ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
11462024-06-28T20:20:04.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 87.13775ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
11472024-06-28T20:20:04.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.371769477s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
11482024-06-28T20:20:04.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.190503908s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
11492024-06-28T20:20:04.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.004962992s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
11502024-06-28T20:20:04.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.123075107s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
11512024-06-28T20:20:04.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 182.462068ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
11522024-06-28T20:20:04.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 393.449549ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
11532024-06-28T20:20:04.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 434.259495ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
11542024-06-28T20:20:04.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 916.746799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
11552024-06-28T20:20:04.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 778.872266ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
11562024-06-28T20:20:04.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.164043282s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
11572024-06-28T20:20:04.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 938.751638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
11582024-06-28T20:20:04.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.101053243s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
11592024-06-28T20:20:04.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 510.407416ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
11602024-06-28T20:20:04.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.039779215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
11612024-06-28T20:20:04.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 934.40385ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
11622024-06-28T20:20:04.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.492983328s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
11632024-06-28T20:20:04.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 839.218056ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
11642024-06-28T20:20:04.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.230583817s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
11652024-06-28T20:20:04.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 845.510413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
11662024-06-28T20:20:05.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.361019367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
11672024-06-28T20:20:05.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.267949953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
11682024-06-28T20:20:05.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.252007808s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
11692024-06-28T20:20:05.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 680.778147ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
11702024-06-28T20:20:05.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 1.481580468s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
11712024-06-28T20:20:05.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 828.789066ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
11722024-06-28T20:20:05.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 978.634134ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
11732024-06-28T20:20:05.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.156901635s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
11742024-06-28T20:20:05.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 780.341888ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
11752024-06-28T20:20:05.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 950.773946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
11762024-06-28T20:20:05.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 522.608049ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
11772024-06-28T20:20:05.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.334392498s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
11782024-06-28T20:20:05.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.146157214s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
11792024-06-28T20:20:05.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.15049227s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
11802024-06-28T20:20:05.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 904.849267ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
11812024-06-28T20:20:06.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.179323476s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
11822024-06-28T20:20:06.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.10471781s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
11832024-06-28T20:20:06.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.292678497s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
11842024-06-28T20:20:06.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 636.667616ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
11852024-06-28T20:20:06.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.375069646s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
11862024-06-28T20:20:06.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 908.737295ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
11872024-06-28T20:20:06.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 1.000996655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
11882024-06-28T20:20:06.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.03095779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
11892024-06-28T20:20:06.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.272370352s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
11902024-06-28T20:20:06.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.245591987s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
11912024-06-28T20:20:06.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.45348942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
11922024-06-28T20:20:06.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.067323821s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
11932024-06-28T20:20:06.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 820.114767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
11942024-06-28T20:20:06.796ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.338350919s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
11952024-06-28T20:20:06.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 848.177968ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
11962024-06-28T20:20:06.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 1.307711145s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
11972024-06-28T20:20:06.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 769.04154ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
11982024-06-28T20:20:07.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.142792674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
11992024-06-28T20:20:07.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.23723152s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
12002024-06-28T20:20:07.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.168325647s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
12012024-06-28T20:20:07.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 670.661772ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
12022024-06-28T20:20:07.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.02828447s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
12032024-06-28T20:20:07.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 521.442008ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
12042024-06-28T20:20:07.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 503.822844ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
12052024-06-28T20:20:07.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 516.326163ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
12062024-06-28T20:20:07.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.49796498s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
12072024-06-28T20:20:07.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 1.114128909s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
12082024-06-28T20:20:07.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.100730472s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
12092024-06-28T20:20:07.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 709.013168ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
12102024-06-28T20:20:07.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.425631508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
12112024-06-28T20:20:07.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 571.072158ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
12122024-06-28T20:20:07.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 507.30077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
12132024-06-28T20:20:07.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 1.179509569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
12142024-06-28T20:20:07.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 1.305739167s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
12152024-06-28T20:20:08.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 717.473058ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
12162024-06-28T20:20:08.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.375997254s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
12172024-06-28T20:20:08.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.285620261s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
12182024-06-28T20:20:08.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.016459398s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
12192024-06-28T20:20:08.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 1.351364603s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
12202024-06-28T20:20:08.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.421992259s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
12212024-06-28T20:20:08.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.232808362s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
12222024-06-28T20:20:08.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 998.281355ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
12232024-06-28T20:20:08.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 578.701183ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
12242024-06-28T20:20:08.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 991.443503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
12252024-06-28T20:20:08.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.355043281s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
12262024-06-28T20:20:08.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 541.626769ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
12272024-06-28T20:20:08.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 953.106165ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
12282024-06-28T20:20:08.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.40306408s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
12292024-06-28T20:20:09.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.411447233s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
12302024-06-28T20:20:09.086ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService27"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::a"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value="vopte4"/> <propval type="astring" name="gateway" value="172.30.2.1"/> <propval type="astring" name="ip" value="172.30.2.5"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12312024-06-28T20:20:09.086ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
12322024-06-28T20:20:09.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.036067525s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
12332024-06-28T20:20:09.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 1.10121984s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
12342024-06-28T20:20:09.254ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 703.2218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
12352024-06-28T20:20:09.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.097376109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
12362024-06-28T20:20:09.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 58.584373ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
12372024-06-28T20:20:09.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 1.041698125s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
12382024-06-28T20:20:09.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 105.155999ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
12392024-06-28T20:20:09.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 754.874945ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
12402024-06-28T20:20:09.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.360879102s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
12412024-06-28T20:20:09.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.226278667s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
12422024-06-28T20:20:09.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 288.014611ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
12432024-06-28T20:20:09.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 842.206488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
12442024-06-28T20:20:09.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.335093931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
12452024-06-28T20:20:09.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.295742257s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
12462024-06-28T20:20:09.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 662.785978ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
12472024-06-28T20:20:09.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 326.622909ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
12482024-06-28T20:20:09.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 863.35016ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
12492024-06-28T20:20:09.830ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 533.304837ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
12502024-06-28T20:20:09.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 759.250488ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
12512024-06-28T20:20:09.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 985.157545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
12522024-06-28T20:20:10.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 879.781873ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
12532024-06-28T20:20:10.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.313375207s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
12542024-06-28T20:20:10.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.341970868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
12552024-06-28T20:20:10.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 586.049153ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
12562024-06-28T20:20:10.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.205997923s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
12572024-06-28T20:20:10.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 762.971251ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
12582024-06-28T20:20:10.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.374404539s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
12592024-06-28T20:20:10.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 1.334727946s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
12602024-06-28T20:20:10.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 878.695262ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
12612024-06-28T20:20:10.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 924.220553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
12622024-06-28T20:20:10.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 969.240541ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
12632024-06-28T20:20:10.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.233164835s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
12642024-06-28T20:20:10.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.151345351s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
12652024-06-28T20:20:10.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.079535959s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
12662024-06-28T20:20:10.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.24915463s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
12672024-06-28T20:20:10.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 867.325607ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
12682024-06-28T20:20:10.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 949.220446ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
12692024-06-28T20:20:10.931ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 744.092764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
12702024-06-28T20:20:10.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.385592128s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
12712024-06-28T20:20:10.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 605.959079ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
12722024-06-28T20:20:11.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 926.896615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
12732024-06-28T20:20:11.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 1.34225875s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
12742024-06-28T20:20:11.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 611.557568ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
12752024-06-28T20:20:11.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 900.776936ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
12762024-06-28T20:20:11.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.228238562s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
12772024-06-28T20:20:11.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.061769903s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
12782024-06-28T20:20:11.511ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 745.672934ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
12792024-06-28T20:20:11.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 1.325998205s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
12802024-06-28T20:20:11.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 735.014564ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
12812024-06-28T20:20:11.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 602.788951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
12822024-06-28T20:20:11.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 897.564902ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
12832024-06-28T20:20:11.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 899.871652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
12842024-06-28T20:20:11.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 755.163139ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
12852024-06-28T20:20:11.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 901.075373ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
12862024-06-28T20:20:11.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 787.489533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
12872024-06-28T20:20:11.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 587.330117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
12882024-06-28T20:20:11.940ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.410546618s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
12892024-06-28T20:20:12.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.295312711s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
12902024-06-28T20:20:12.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 1.245756512s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
12912024-06-28T20:20:12.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.012756749s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
12922024-06-28T20:20:12.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 829.666464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
12932024-06-28T20:20:12.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 897.00351ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
12942024-06-28T20:20:12.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.208295322s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
12952024-06-28T20:20:12.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 506.170736ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
12962024-06-28T20:20:12.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.350785843s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
12972024-06-28T20:20:12.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 611.240885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
12982024-06-28T20:20:12.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.268877378s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
12992024-06-28T20:20:12.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 753.636699ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
13002024-06-28T20:20:12.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.090399574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
13012024-06-28T20:20:12.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 904.979718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
13022024-06-28T20:20:12.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 710.647761ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
13032024-06-28T20:20:12.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 592.885172ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
13042024-06-28T20:20:12.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 993.202397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
13052024-06-28T20:20:12.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.137178193s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
13062024-06-28T20:20:12.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 1.257338403s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
13072024-06-28T20:20:13.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 1.180280123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
13082024-06-28T20:20:13.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.333450609s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
13092024-06-28T20:20:13.198ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlService17"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="static_addr" value="fd00:1122:3344:101::e"/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::e"/> <propval type="astring" name="listen_port" value="8123"/> <propval type="astring" name="store" value="/data"/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> <value_node value="fd00:1122:3344:1::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13102024-06-28T20:20:13.199ZINFOSledAgent (ServiceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
13112024-06-28T20:20:13.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.226867507s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
13122024-06-28T20:20:13.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 884.834095ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
13132024-06-28T20:20:13.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 633.412856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
13142024-06-28T20:20:13.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 1.05433476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
13152024-06-28T20:20:13.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 703.877913ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
13162024-06-28T20:20:13.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.073002237s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
13172024-06-28T20:20:13.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 904.6637ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
13182024-06-28T20:20:13.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 789.771405ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
13192024-06-28T20:20:13.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 36.918057ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
13202024-06-28T20:20:13.455ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 141.362634ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
13212024-06-28T20:20:13.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 1.258479407s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
13222024-06-28T20:20:13.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 665.715843ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
13232024-06-28T20:20:13.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 228.690535ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
13242024-06-28T20:20:13.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.309861728s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
13252024-06-28T20:20:13.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 501.417076ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
13262024-06-28T20:20:13.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 935.285084ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
13272024-06-28T20:20:13.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 490.246259ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
13282024-06-28T20:20:13.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 568.189804ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
13292024-06-28T20:20:13.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.065276683s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
13302024-06-28T20:20:14.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.220132175s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
13312024-06-28T20:20:14.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 831.842315ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
13322024-06-28T20:20:14.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 729.664757ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
13332024-06-28T20:20:14.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 979.977119ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
13342024-06-28T20:20:14.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 528.527882ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
13352024-06-28T20:20:14.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.366411266s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
13362024-06-28T20:20:14.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.124113782s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
13372024-06-28T20:20:14.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 878.001579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
13382024-06-28T20:20:14.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 758.972757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
13392024-06-28T20:20:14.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 789.631719ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
13402024-06-28T20:20:14.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 932.357855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
13412024-06-28T20:20:14.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 838.344201ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
13422024-06-28T20:20:14.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 839.763799ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
13432024-06-28T20:20:14.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.136728392s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
13442024-06-28T20:20:14.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.467122128s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
13452024-06-28T20:20:14.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 1.365811114s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
13462024-06-28T20:20:14.788ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 595.087944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
13472024-06-28T20:20:14.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 804.959249ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
13482024-06-28T20:20:14.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.273178843s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
13492024-06-28T20:20:14.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.262349176s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
13502024-06-28T20:20:15.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.440817982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
13512024-06-28T20:20:15.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.22291554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
13522024-06-28T20:20:15.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 706.161464ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
13532024-06-28T20:20:15.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 776.710476ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
13542024-06-28T20:20:15.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 841.855018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
13552024-06-28T20:20:15.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 811.277097ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
13562024-06-28T20:20:15.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.165760548s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
13572024-06-28T20:20:15.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 778.297573ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
13582024-06-28T20:20:15.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 661.487402ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
13592024-06-28T20:20:15.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 763.371204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
13602024-06-28T20:20:15.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 788.400111ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
13612024-06-28T20:20:15.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.462190206s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
13622024-06-28T20:20:15.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 897.863877ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
13632024-06-28T20:20:15.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 1.207986277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
13642024-06-28T20:20:15.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 966.742306ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
13652024-06-28T20:20:15.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 679.351178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
13662024-06-28T20:20:15.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 1.018780371s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
13672024-06-28T20:20:15.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 786.884467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
13682024-06-28T20:20:16.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 777.376106ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
13692024-06-28T20:20:16.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 1.469747434s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
13702024-06-28T20:20:16.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 751.143255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
13712024-06-28T20:20:16.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.151436983s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
13722024-06-28T20:20:16.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 788.73429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
13732024-06-28T20:20:16.154ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 837.085706ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
13742024-06-28T20:20:16.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.449248002s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
13752024-06-28T20:20:16.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.2717112s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
13762024-06-28T20:20:16.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.399105204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
13772024-06-28T20:20:16.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 765.398743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
13782024-06-28T20:20:16.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.272708592s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
13792024-06-28T20:20:16.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.457291624s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
13802024-06-28T20:20:16.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 1.485815598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
13812024-06-28T20:20:16.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.063360756s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
13822024-06-28T20:20:16.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.246276216s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
13832024-06-28T20:20:16.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 567.983023ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
13842024-06-28T20:20:16.804ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 889.980968ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
13852024-06-28T20:20:16.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 801.709266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
13862024-06-28T20:20:16.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 680.601859ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
13872024-06-28T20:20:16.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.42236147s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
13882024-06-28T20:20:16.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.004119647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
13892024-06-28T20:20:16.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 1.226641665s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
13902024-06-28T20:20:17.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 1.041993002s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
13912024-06-28T20:20:17.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.230306112s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
13922024-06-28T20:20:17.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.375016754s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
13932024-06-28T20:20:17.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.072758432s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
13942024-06-28T20:20:17.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 730.929786ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
13952024-06-28T20:20:17.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 958.668593ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
13962024-06-28T20:20:17.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 513.997045ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
13972024-06-28T20:20:17.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.003199647s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
13982024-06-28T20:20:17.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 597.935613ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
13992024-06-28T20:20:17.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 939.139025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
14002024-06-28T20:20:17.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 871.955683ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
14012024-06-28T20:20:17.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 890.315768ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
14022024-06-28T20:20:17.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.233804055s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
14032024-06-28T20:20:17.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.102657847s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
14042024-06-28T20:20:17.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.191679875s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
14052024-06-28T20:20:17.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.344649707s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
14062024-06-28T20:20:18.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 1.123591361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
14072024-06-28T20:20:18.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 1.38629954s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
14082024-06-28T20:20:18.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 1.391091873s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
14092024-06-28T20:20:18.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 1.324306501s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
14102024-06-28T20:20:18.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.477129001s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
14112024-06-28T20:20:18.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.009957949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
14122024-06-28T20:20:18.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.007192268s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
14132024-06-28T20:20:18.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.336350501s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
14142024-06-28T20:20:18.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.192380909s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
14152024-06-28T20:20:18.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 646.262685ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
14162024-06-28T20:20:18.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 591.910653ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
14172024-06-28T20:20:18.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 576.623759ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
14182024-06-28T20:20:18.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 1.011421109s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
14192024-06-28T20:20:18.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 1.236983507s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
14202024-06-28T20:20:18.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 592.996222ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
14212024-06-28T20:20:18.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 549.035521ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
14222024-06-28T20:20:19.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 878.722625ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
14232024-06-28T20:20:19.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 1.431531404s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
14242024-06-28T20:20:19.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 1.154440127s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
14252024-06-28T20:20:19.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 1.434220953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
14262024-06-28T20:20:19.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 661.827346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
14272024-06-28T20:20:19.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 1.194974262s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
14282024-06-28T20:20:19.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 1.242719231s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
14292024-06-28T20:20:19.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.322019663s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
14302024-06-28T20:20:19.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 733.666024ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
14312024-06-28T20:20:19.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 859.683155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
14322024-06-28T20:20:19.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 1.38160427s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
14332024-06-28T20:20:19.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a") failed: Property not found. retry in 885.994925ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
14342024-06-28T20:20:19.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 1.263320518s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
14352024-06-28T20:20:19.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.217923911s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
14362024-06-28T20:20:19.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3") failed: Property not found. retry in 1.256672643s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
14372024-06-28T20:20:19.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774") failed: Property not found. retry in 1.364968567s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
14382024-06-28T20:20:19.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 782.002258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
14392024-06-28T20:20:19.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 633.427336ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
14402024-06-28T20:20:19.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 600.264652ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
14412024-06-28T20:20:19.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d") failed: Property not found. retry in 913.486983ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
14422024-06-28T20:20:19.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 725.859503ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
14432024-06-28T20:20:20.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36") failed: Property not found. retry in 1.05732868s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
14442024-06-28T20:20:20.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc") failed: Property not found. retry in 1.030902316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
14452024-06-28T20:20:20.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194") failed: Property not found. retry in 1.269588992s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
14462024-06-28T20:20:20.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476") failed: Property not found. retry in 1.362941308s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
14472024-06-28T20:20:20.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e") failed: Property not found. retry in 541.034686ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
14482024-06-28T20:20:20.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573") failed: Property not found. retry in 1.2203965s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
14492024-06-28T20:20:20.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33") failed: Property not found. retry in 1.382170934s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
14502024-06-28T20:20:20.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d") failed: Property not found. retry in 987.036519ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
14512024-06-28T20:20:20.521ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39046
14522024-06-28T20:20:20.523ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1416 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39046 req_id = fda81336-2168-42e8-8da7-64af55893b9e response_code = 200 uri = /baseboard
14532024-06-28T20:20:20.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482") failed: Property not found. retry in 930.98359ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
14542024-06-28T20:20:20.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec") failed: Property not found. retry in 703.297453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
14552024-06-28T20:20:20.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc") failed: Property not found. retry in 1.179920931s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
14562024-06-28T20:20:20.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390") failed: Property not found. retry in 1.291400492s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
14572024-06-28T20:20:20.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a") failed: Property not found. retry in 1.205023365s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
14582024-06-28T20:20:20.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c") failed: Property not found. retry in 1.120500235s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
14592024-06-28T20:20:20.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8") failed: Property not found. retry in 712.47932ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
14602024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_nexus_106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a
14612024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_pantry_c306a9e4-a6f3-4e2b-8fc6-e34cb4d6c774
14622024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_external_dns_af471492-15f5-4f5e-8e86-1a6f5fed1194
14632024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_pantry_8cd26a24-e179-4c2b-8ef0-2266755e71bc
14642024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_nexus_2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d
14652024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_d833112f-3a6f-42df-ac2b-4b363ae18dec
14662024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_d9867757-ac46-4856-aef2-786b23e9ebfc
14672024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_380a17ba-30f9-40ef-bba1-dae624407a8a
14682024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_oximeter_0391f077-b9a1-4844-9e70-a95bfc8b9476
14692024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_4d13a6af-add8-4650-88b0-7d15ba1f163d
14702024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_clickhouse_e6272ee2-d571-4677-b748-3ad2a6571d0c
14712024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_6fedf47d-3180-423a-8b74-f67b2ef9bc36
14722024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_f76fcb75-ac1f-4991-a5d4-8220da27a83e
14732024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_nexus_6f5d9265-ef8a-4911-9c83-53b3e7aa91b8
14742024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_pantry_ba9fd631-f22f-4c03-b1e5-c2e6cce72ed3
14752024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_a46ed8b8-c687-449d-94f8-3ba05af89482
14762024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_a63c36c6-a325-485c-9ccb-7977dbb9a573
14772024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_crucible_6fc0d54c-41e9-4485-919d-d85a89e9ab33
14782024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:2966 zone = oxz_external_dns_822a6774-7180-42fa-b51d-f435fb7cb390
14792024-06-28T20:20:22.039ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14802024-06-28T20:20:22.044ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
14812024-06-28T20:20:22.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 31552325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:39280 req_id = a9e4461e-3ee1-4534-beed-25669309a6f1 response_code = 204 uri = /omicron-zones
14822024-06-28T20:20:22.068ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1244
14832024-06-28T20:20:22.069ZINFOSledAgent (RSS): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14842024-06-28T20:20:22.069ZINFOSledAgent (RSS): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
14852024-06-28T20:20:22.073ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:681
14862024-06-28T20:20:22.086ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:694
14872024-06-28T20:20:22.141ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, }, ], switch: Switch0, uplink_port_fec: None, uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:825
14882024-06-28T20:20:23.235ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.416002569s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): operation timed out" file = oximeter/producer/src/lib.rs:423 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
14892024-06-28T20:20:23.452ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14902024-06-28T20:20:23.574ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14912024-06-28T20:20:23.667ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14922024-06-28T20:20:23.796ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14932024-06-28T20:20:23.888ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14942024-06-28T20:20:24.011ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14952024-06-28T20:20:24.375ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14962024-06-28T20:20:24.599ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14972024-06-28T20:20:25.112ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14982024-06-28T20:20:25.514ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
14992024-06-28T20:20:25.682ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 10.508982967s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers): error trying to connect: tcp connect error: Connection refused (os error 146)" file = oximeter/producer/src/lib.rs:423 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
15002024-06-28T20:20:25.854ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15012024-06-28T20:20:26.534ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15022024-06-28T20:20:26.952ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15032024-06-28T20:20:27.673ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15042024-06-28T20:20:29.104ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15052024-06-28T20:20:30.113ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15062024-06-28T20:20:30.899ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15072024-06-28T20:20:32.277ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/ca9c69df-17fe-4aff-be49-d2dc33212dbe/initialization-complete): error trying to connect: tcp connect error: Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:887
15082024-06-28T20:20:35.894ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "692775e5-ccf9-41c3-b4ed-625951c14bb7", "content-length": "173", "date": "Fri, 28 Jun 2024 20:20:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6aa3805-f338-41a1-9087-e851abde3933\"", request_id: "692775e5-ccf9-41c3-b4ed-625951c14bb7" } file = sled-agent/src/rack_setup/service.rs:887
15092024-06-28T20:20:38.903ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c2a699d9-2325-4658-b911-169a17a8321d", "content-length": "173", "date": "Fri, 28 Jun 2024 20:20:38 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6aa3805-f338-41a1-9087-e851abde3933\"", request_id: "c2a699d9-2325-4658-b911-169a17a8321d" } file = sled-agent/src/rack_setup/service.rs:887
15102024-06-28T20:20:43.339ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "2da04d5f-5fe8-49d4-8a28-f6f02c2c0e81", "content-length": "173", "date": "Fri, 28 Jun 2024 20:20:43 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6aa3805-f338-41a1-9087-e851abde3933\"", request_id: "2da04d5f-5fe8-49d4-8a28-f6f02c2c0e81" } file = sled-agent/src/rack_setup/service.rs:887
15112024-06-28T20:20:48.741ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b848fa8b-e462-452b-8efe-246aa30eaa0e", "content-length": "173", "date": "Fri, 28 Jun 2024 20:20:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6aa3805-f338-41a1-9087-e851abde3933\"", request_id: "b848fa8b-e462-452b-8efe-246aa30eaa0e" } file = sled-agent/src/rack_setup/service.rs:887
15122024-06-28T20:20:50.571ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45054
15132024-06-28T20:20:50.571ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45054 req_id = b6abedba-b750-44b3-8199-84d9785784fe response_code = 200 uri = /baseboard
15142024-06-28T20:20:53.144ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1576a96d-5d4e-427a-8644-3791a9e817ab", "content-length": "173", "date": "Fri, 28 Jun 2024 20:20:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6aa3805-f338-41a1-9087-e851abde3933\"", request_id: "1576a96d-5d4e-427a-8644-3791a9e817ab" } file = sled-agent/src/rack_setup/service.rs:887
15152024-06-28T20:21:01.041ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "10186c4f-8871-48f1-bdff-d1ecfc704b2a", "content-length": "173", "date": "Fri, 28 Jun 2024 20:21:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6aa3805-f338-41a1-9087-e851abde3933\"", request_id: "10186c4f-8871-48f1-bdff-d1ecfc704b2a" } file = sled-agent/src/rack_setup/service.rs:887
15162024-06-28T20:21:01.419ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:592 new_generation = 1 old_generation = 1 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
15172024-06-28T20:21:01.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34872
15182024-06-28T20:21:01.503ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
15192024-06-28T20:21:01.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 90671 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34872 req_id = dd52f543-52ce-40f1-9c9e-15897fa0139e response_code = 200 uri = /inventory
15202024-06-28T20:21:01.594ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
15212024-06-28T20:21:01.594ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/omicron-zones.json file = common/src/ledger.rs:177
15222024-06-28T20:21:01.596ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/omicron-zones.json file = common/src/ledger.rs:177
15232024-06-28T20:21:01.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34872 req_id = 14270b41-2a37-4022-882d-331cd370d4df response_code = 200 uri = /omicron-zones
15242024-06-28T20:21:03.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45834
15252024-06-28T20:21:03.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 808 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45834 req_id = ea062ffe-e02a-4c85-acda-b72815080c1b response_code = 200 uri = /vpc-routes
15262024-06-28T20:21:03.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39229
15272024-06-28T20:21:03.600ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39229 req_id = e18e32b6-096c-45c9-b56a-3003a5686ba5 response_code = 200 uri = /vpc-routes
15282024-06-28T20:21:03.634ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37673
15292024-06-28T20:21:03.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 930 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37673 req_id = c4255587-5c7b-4b19-b164-641510ff1572 response_code = 200 uri = /v2p
15302024-06-28T20:21:03.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58170
15312024-06-28T20:21:03.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 34 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58170 req_id = c9942aca-070a-4978-a3bc-0dea954d8261 response_code = 200 uri = /vpc-routes
15322024-06-28T20:21:03.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60548
15332024-06-28T20:21:03.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60548 req_id = 830cc84e-d2ff-43a4-ad9a-21f11eb6ae4e response_code = 200 uri = /v2p
15342024-06-28T20:21:03.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 7420 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45834 req_id = fe4fa24d-3bbd-4c02-acad-06cdd32bac64 response_code = 204 uri = /vpc-routes
15352024-06-28T20:21:03.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62695
15362024-06-28T20:21:03.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 704 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62695 req_id = e7384638-1ff5-4804-a623-f968112874c4 response_code = 200 uri = /v2p
15372024-06-28T20:21:03.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39229 req_id = b98514ad-8db9-465f-b1f5-9cf0a4b28887 response_code = 204 uri = /vpc-routes
15382024-06-28T20:21:03.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58170 req_id = da09e24c-af8f-4afc-8926-9854678342cf response_code = 204 uri = /vpc-routes
15392024-06-28T20:21:06.319ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:37179 remote_addr = [fd00:1122:3344:101::d]:47084 sled_id = e6aa3805-f338-41a1-9087-e851abde3933
15402024-06-28T20:21:06.328ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 6063 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 26f6effd-e763-401e-8220-1b35f1895347 response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
15412024-06-28T20:21:08.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39599
15422024-06-28T20:21:08.413ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:725 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3784a80e-4ca5-4f13-872e-b0c3f0386cb2, kind: Service { id: 822a6774-7180-42fa-b51d-f435fb7cb390 }, name: Name("external-dns-822a6774-7180-42fa-b51d-f435fb7cb390"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4a25946c-409b-4dd7-b387-5787a229c6cd, kind: Service { id: af471492-15f5-4f5e-8e86-1a6f5fed1194 }, name: Name("external-dns-af471492-15f5-4f5e-8e86-1a6f5fed1194"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 36efc940-600c-4377-bde8-924b208bd6df, kind: Service { id: 2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d }, name: Name("nexus-2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a68d6849-d9e0-466b-ac4f-07da426a0fcd, kind: Service { id: 106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a }, name: Name("nexus-106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa47896d-e04d-4f67-8af5-28d86a4805bb, kind: Service { id: 6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 }, name: Name("nexus-6f5d9265-ef8a-4911-9c83-53b3e7aa91b8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15432024-06-28T20:21:08.414ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15442024-06-28T20:21:08.414ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15452024-06-28T20:21:08.414ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15462024-06-28T20:21:08.414ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15472024-06-28T20:21:08.414ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte0" rules = []
15482024-06-28T20:21:08.414ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15492024-06-28T20:21:08.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3051 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39599 req_id = 89cadd48-c17f-400a-b380-c9b98aad3497 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15502024-06-28T20:21:08.416ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:897
15512024-06-28T20:21:08.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48176
15522024-06-28T20:21:08.561ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
15532024-06-28T20:21:08.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 90278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48176 req_id = 60aa1b5e-946f-41ae-ab5b-c7a40ace241c response_code = 200 uri = /inventory
15542024-06-28T20:21:08.652ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
15552024-06-28T20:21:08.652ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/893e883e-0735-4681-80b4-298a478763ff/config/omicron-zones.json file = common/src/ledger.rs:177
15562024-06-28T20:21:08.652ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/config/omicron-zones.json file = common/src/ledger.rs:177
15572024-06-28T20:21:08.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 896 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48176 req_id = d174783a-b78e-4cfe-ba55-cee95408c856 response_code = 200 uri = /omicron-zones
15582024-06-28T20:21:09.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59772
15592024-06-28T20:21:09.833ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:725 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3784a80e-4ca5-4f13-872e-b0c3f0386cb2, kind: Service { id: 822a6774-7180-42fa-b51d-f435fb7cb390 }, name: Name("external-dns-822a6774-7180-42fa-b51d-f435fb7cb390"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4a25946c-409b-4dd7-b387-5787a229c6cd, kind: Service { id: af471492-15f5-4f5e-8e86-1a6f5fed1194 }, name: Name("external-dns-af471492-15f5-4f5e-8e86-1a6f5fed1194"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 36efc940-600c-4377-bde8-924b208bd6df, kind: Service { id: 2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d }, name: Name("nexus-2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a68d6849-d9e0-466b-ac4f-07da426a0fcd, kind: Service { id: 106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a }, name: Name("nexus-106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa47896d-e04d-4f67-8af5-28d86a4805bb, kind: Service { id: 6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 }, name: Name("nexus-6f5d9265-ef8a-4911-9c83-53b3e7aa91b8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15602024-06-28T20:21:09.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15612024-06-28T20:21:09.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15622024-06-28T20:21:09.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15632024-06-28T20:21:09.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15642024-06-28T20:21:09.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte0" rules = []
15652024-06-28T20:21:09.833ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15662024-06-28T20:21:09.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 410 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59772 req_id = 9e17bf50-8386-4eae-be5d-ce45b51df980 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15672024-06-28T20:21:09.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38180
15682024-06-28T20:21:09.861ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:725 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3784a80e-4ca5-4f13-872e-b0c3f0386cb2, kind: Service { id: 822a6774-7180-42fa-b51d-f435fb7cb390 }, name: Name("external-dns-822a6774-7180-42fa-b51d-f435fb7cb390"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4a25946c-409b-4dd7-b387-5787a229c6cd, kind: Service { id: af471492-15f5-4f5e-8e86-1a6f5fed1194 }, name: Name("external-dns-af471492-15f5-4f5e-8e86-1a6f5fed1194"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 36efc940-600c-4377-bde8-924b208bd6df, kind: Service { id: 2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d }, name: Name("nexus-2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a68d6849-d9e0-466b-ac4f-07da426a0fcd, kind: Service { id: 106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a }, name: Name("nexus-106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa47896d-e04d-4f67-8af5-28d86a4805bb, kind: Service { id: 6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 }, name: Name("nexus-6f5d9265-ef8a-4911-9c83-53b3e7aa91b8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15692024-06-28T20:21:09.861ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15702024-06-28T20:21:09.861ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15712024-06-28T20:21:09.861ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15722024-06-28T20:21:09.861ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15732024-06-28T20:21:09.861ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte0" rules = []
15742024-06-28T20:21:09.861ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15752024-06-28T20:21:09.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 296 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38180 req_id = cf67aaee-0c07-4389-8b88-12c5f2b73040 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15762024-06-28T20:21:09.910ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39431
15772024-06-28T20:21:09.910ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:725 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3784a80e-4ca5-4f13-872e-b0c3f0386cb2, kind: Service { id: 822a6774-7180-42fa-b51d-f435fb7cb390 }, name: Name("external-dns-822a6774-7180-42fa-b51d-f435fb7cb390"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4a25946c-409b-4dd7-b387-5787a229c6cd, kind: Service { id: af471492-15f5-4f5e-8e86-1a6f5fed1194 }, name: Name("external-dns-af471492-15f5-4f5e-8e86-1a6f5fed1194"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 36efc940-600c-4377-bde8-924b208bd6df, kind: Service { id: 2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d }, name: Name("nexus-2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a68d6849-d9e0-466b-ac4f-07da426a0fcd, kind: Service { id: 106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a }, name: Name("nexus-106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa47896d-e04d-4f67-8af5-28d86a4805bb, kind: Service { id: 6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 }, name: Name("nexus-6f5d9265-ef8a-4911-9c83-53b3e7aa91b8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
15782024-06-28T20:21:09.910ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15792024-06-28T20:21:09.910ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15802024-06-28T20:21:09.910ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
15812024-06-28T20:21:09.910ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15822024-06-28T20:21:09.910ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte0" rules = []
15832024-06-28T20:21:09.910ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
15842024-06-28T20:21:09.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39431 req_id = af7eb7c0-a283-4097-a7a8-d05c028b4937 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
15852024-06-28T20:21:14.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38232
15862024-06-28T20:21:14.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38232 req_id = 2128e5e6-f3a7-4d45-970f-9dff32a6c7e6 response_code = 200 uri = /vpc-routes
15872024-06-28T20:21:14.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38232 req_id = 6a033399-51b4-461b-b534-8bc7d7032f49 response_code = 204 uri = /vpc-routes
15882024-06-28T20:21:20.604ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59127
15892024-06-28T20:21:20.604ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 624 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59127 req_id = 86103cec-ee14-4f55-bfff-095da6a56eb8 response_code = 200 uri = /baseboard
15902024-06-28T20:21:33.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52620
15912024-06-28T20:21:33.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52620 req_id = 3d89f102-c8ac-4303-9fef-d8a170867bc2 response_code = 200 uri = /vpc-routes
15922024-06-28T20:21:33.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52620 req_id = 33142d8c-72e9-438e-b5fb-e3fcd72c0f23 response_code = 204 uri = /vpc-routes
15932024-06-28T20:21:33.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62327
15942024-06-28T20:21:33.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62327 req_id = b04f5ded-583a-4e77-a964-554a0d0e3acd response_code = 200 uri = /vpc-routes
15952024-06-28T20:21:33.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62327 req_id = 7c4399c3-2fbc-4b4c-b09d-136decab9f26 response_code = 204 uri = /vpc-routes
15962024-06-28T20:21:33.651ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45258
15972024-06-28T20:21:33.651ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45258 req_id = b21417d2-405a-453e-99cc-431d27ff9489 response_code = 200 uri = /v2p
15982024-06-28T20:21:33.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46194
15992024-06-28T20:21:33.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46194 req_id = 2b8dfdbc-34ea-4365-bd1e-b1ad4ee95839 response_code = 200 uri = /v2p
16002024-06-28T20:21:33.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54405
16012024-06-28T20:21:33.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54405 req_id = ce31869d-f2e2-46ea-a724-3a9f62ca9657 response_code = 200 uri = /vpc-routes
16022024-06-28T20:21:33.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54405 req_id = 14073aea-38ba-45b9-a565-9b177c70eba1 response_code = 204 uri = /vpc-routes
16032024-06-28T20:21:33.849ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58991
16042024-06-28T20:21:33.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58991 req_id = d77e2b0a-f1ed-4bcc-9b14-314e8d8ffc56 response_code = 200 uri = /v2p
16052024-06-28T20:21:33.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40670
16062024-06-28T20:21:34.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 115455 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40670 req_id = bc284029-029d-4fa0-a046-5ce5df96977e response_code = 204 uri = /switch-ports
16072024-06-28T20:21:34.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51277
16082024-06-28T20:21:34.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55942
16092024-06-28T20:21:34.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4928 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40670 req_id = 1015cf9c-da63-4c98-bd92-9913e1034346 response_code = 200 uri = /network-bootstore-config
16102024-06-28T20:21:34.144ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
16112024-06-28T20:21:34.144ZINFOSledAgent (bootstore): Writing ledger to /pool/int/893e883e-0735-4681-80b4-298a478763ff/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16122024-06-28T20:21:34.146ZINFOSledAgent (bootstore): Writing ledger to /pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16132024-06-28T20:21:34.146ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
16142024-06-28T20:21:34.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 4038 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40670 req_id = 50b6f23f-1b51-4271-ba74-55de5d02a9d7 response_code = 204 uri = /network-bootstore-config
16152024-06-28T20:21:34.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 71523 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51277 req_id = d7e2f7ef-6d25-4bcf-9d7a-603041528c67 response_code = 204 uri = /switch-ports
16162024-06-28T20:21:34.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 710 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51277 req_id = 2fbcba25-86f3-4748-a30d-a4cc4c2bedc5 response_code = 200 uri = /network-bootstore-config
16172024-06-28T20:21:34.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 122924 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55942 req_id = f8106c87-c696-4ff1-9b9f-40c13709aeb2 response_code = 204 uri = /switch-ports
16182024-06-28T20:21:34.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 828 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55942 req_id = 3191d93b-17b4-4c58-b90a-e22836c1e364 response_code = 200 uri = /network-bootstore-config
16192024-06-28T20:21:36.321ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 924 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = f53b2475-90a0-41f7-a16f-5ef9ffae2c91 response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
16202024-06-28T20:21:50.637ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42058
16212024-06-28T20:21:50.637ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42058 req_id = 704ea035-e954-4c4d-8aac-a954f7101fd7 response_code = 200 uri = /baseboard
16222024-06-28T20:22:03.511ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45570
16232024-06-28T20:22:03.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45570 req_id = 72fde0b0-ec71-445a-aef4-dec90b2be06a response_code = 200 uri = /vpc-routes
16242024-06-28T20:22:03.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45570 req_id = 662d80b8-449c-40a3-9419-942e006ffbca response_code = 204 uri = /vpc-routes
16252024-06-28T20:22:03.566ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53868
16262024-06-28T20:22:03.566ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53868 req_id = a1a0b723-94fa-4fad-8aa1-de207b653fd2 response_code = 200 uri = /vpc-routes
16272024-06-28T20:22:03.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53868 req_id = 2923bcaf-0389-425f-8e76-74d3690d2ec4 response_code = 204 uri = /vpc-routes
16282024-06-28T20:22:03.684ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33429
16292024-06-28T20:22:03.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33429 req_id = fd5235c1-c41e-418e-8440-7f89ef4ddf5a response_code = 200 uri = /v2p
16302024-06-28T20:22:03.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46254
16312024-06-28T20:22:03.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46254 req_id = 9fac266f-4496-47b7-bcf3-72e2312ede28 response_code = 200 uri = /vpc-routes
16322024-06-28T20:22:03.693ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59146
16332024-06-28T20:22:03.693ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59146 req_id = 03792708-7328-4975-bc1a-cb709c314266 response_code = 200 uri = /v2p
16342024-06-28T20:22:03.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46254 req_id = aee98810-2f66-4262-8f64-501b14fa5a40 response_code = 204 uri = /vpc-routes
16352024-06-28T20:22:03.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42303
16362024-06-28T20:22:03.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 722 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42303 req_id = f707dfaa-95b7-4cd4-875d-f382d3f8388e response_code = 200 uri = /v2p
16372024-06-28T20:22:03.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45020
16382024-06-28T20:22:03.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47420 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45020 req_id = 422f63c4-09ab-4dcc-b57f-3706cb6668e5 response_code = 204 uri = /switch-ports
16392024-06-28T20:22:03.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40147
16402024-06-28T20:22:03.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53153
16412024-06-28T20:22:03.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3383 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45020 req_id = 995a10be-68fa-4037-b648-7e7c54945196 response_code = 200 uri = /network-bootstore-config
16422024-06-28T20:22:03.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43856 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40147 req_id = 79e34745-a33a-4dea-8b41-86a2bb97dbe1 response_code = 204 uri = /switch-ports
16432024-06-28T20:22:03.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 332 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40147 req_id = 5f501a17-406d-4600-81ce-1834f75f7231 response_code = 200 uri = /network-bootstore-config
16442024-06-28T20:22:03.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 87133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53153 req_id = 1b5b5929-19eb-400f-8441-7adc46575e14 response_code = 204 uri = /switch-ports
16452024-06-28T20:22:03.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53153 req_id = cd29ed3e-44a0-46c4-85af-87520a6b4713 response_code = 200 uri = /network-bootstore-config
16462024-06-28T20:22:06.321ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 624 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 6263986a-28e2-4c38-a8f7-435d4dc93e99 response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
16472024-06-28T20:22:20.669ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61602
16482024-06-28T20:22:20.669ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61602 req_id = 7edbdef5-71cb-4d9c-8bd1-979922192b4d response_code = 200 uri = /baseboard
16492024-06-28T20:22:33.653ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41852
16502024-06-28T20:22:33.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41852 req_id = 434efd52-12c2-4133-9970-990653f2ade7 response_code = 200 uri = /vpc-routes
16512024-06-28T20:22:33.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1541 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41852 req_id = ad51387e-870a-4154-b697-4d71cb87f9cb response_code = 204 uri = /vpc-routes
16522024-06-28T20:22:33.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49611
16532024-06-28T20:22:33.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49611 req_id = 1c8ea794-d641-436b-9433-5078dc722f82 response_code = 200 uri = /vpc-routes
16542024-06-28T20:22:33.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49611 req_id = 06d5bd02-264c-4de1-b8a2-ae2da2272979 response_code = 204 uri = /vpc-routes
16552024-06-28T20:22:33.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62095
16562024-06-28T20:22:33.752ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62095 req_id = 5c3a8aea-d19e-46ad-9c3f-dd978825d520 response_code = 200 uri = /vpc-routes
16572024-06-28T20:22:33.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62095 req_id = 7193902b-3678-459c-af35-2ba409ef3e61 response_code = 204 uri = /vpc-routes
16582024-06-28T20:22:33.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34110
16592024-06-28T20:22:33.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34110 req_id = bec7bf1a-382e-4410-9c27-9df6c70f0f87 response_code = 200 uri = /v2p
16602024-06-28T20:22:33.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36983
16612024-06-28T20:22:33.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36983 req_id = 0a361e29-ef52-4031-ab3a-40094f123dd1 response_code = 200 uri = /v2p
16622024-06-28T20:22:33.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63865
16632024-06-28T20:22:33.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49039 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63865 req_id = 144f7a46-f453-4432-bfc7-617e2642b27f response_code = 204 uri = /switch-ports
16642024-06-28T20:22:33.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40683
16652024-06-28T20:22:33.926ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52193
16662024-06-28T20:22:33.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3494 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52193 req_id = b0843260-e282-407b-8439-3ac6fad0e729 response_code = 200 uri = /v2p
16672024-06-28T20:22:33.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3791 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63865 req_id = d46c8e30-0821-4ca5-b6f1-9f8b46d2f51a response_code = 200 uri = /network-bootstore-config
16682024-06-28T20:22:33.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46865 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40683 req_id = c9be5c7c-6bdb-49d0-85ed-1ce9730e8e2b response_code = 204 uri = /switch-ports
16692024-06-28T20:22:33.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 778 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40683 req_id = 823e49b4-8d37-480e-9c93-1359b00a0b8f response_code = 200 uri = /network-bootstore-config
16702024-06-28T20:22:34.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45558
16712024-06-28T20:22:34.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46299 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45558 req_id = 252118e9-a14d-4428-8283-60ba9dff9d2b response_code = 204 uri = /switch-ports
16722024-06-28T20:22:34.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45558 req_id = 65a5df6d-5436-4eaa-8159-0fa9dd8265dc response_code = 200 uri = /network-bootstore-config
16732024-06-28T20:22:36.322ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1439 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = f363e383-886c-42a9-9aa7-1ec2cb06dfd4 response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
16742024-06-28T20:22:50.700ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35835
16752024-06-28T20:22:50.700ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35835 req_id = 5a5dcc06-cbfe-4f32-bb2f-5456bff6c40d response_code = 200 uri = /baseboard
16762024-06-28T20:23:03.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45026
16772024-06-28T20:23:03.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45026 req_id = 63da2a19-547d-469e-a2e7-e61250556c24 response_code = 200 uri = /vpc-routes
16782024-06-28T20:23:03.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43211
16792024-06-28T20:23:03.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43211 req_id = 34a48e3f-193f-40c0-978f-fddb512262c2 response_code = 200 uri = /vpc-routes
16802024-06-28T20:23:03.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43211 req_id = 19fad15c-4108-4a1c-bf3d-79b118699c27 response_code = 204 uri = /vpc-routes
16812024-06-28T20:23:03.550ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45026 req_id = e14272b4-f172-40a8-b73f-c71c45b4d256 response_code = 204 uri = /vpc-routes
16822024-06-28T20:23:03.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60306
16832024-06-28T20:23:03.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60306 req_id = b3842352-a781-4dea-918e-6b416866d10b response_code = 200 uri = /v2p
16842024-06-28T20:23:03.605ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53208
16852024-06-28T20:23:03.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53208 req_id = b20b021d-5286-41f4-abac-9cf842b6d0d9 response_code = 200 uri = /v2p
16862024-06-28T20:23:03.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65468
16872024-06-28T20:23:03.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65468 req_id = 817ecb3e-7614-40f3-a42b-7df3885a38d3 response_code = 200 uri = /v2p
16882024-06-28T20:23:03.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54610
16892024-06-28T20:23:03.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50778 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54610 req_id = 6574b007-f058-414b-9923-2884a8de8d53 response_code = 204 uri = /switch-ports
16902024-06-28T20:23:03.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50424
16912024-06-28T20:23:03.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54610 req_id = d403ef82-73db-45f7-9565-61eb7321880d response_code = 200 uri = /network-bootstore-config
16922024-06-28T20:23:03.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59439
16932024-06-28T20:23:03.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59439 req_id = 1a8c8949-2728-4e13-adfc-31158aef6e32 response_code = 200 uri = /vpc-routes
16942024-06-28T20:23:03.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59439 req_id = 1aff206f-d8b3-4ea3-b9b1-72ed1fb7a133 response_code = 204 uri = /vpc-routes
16952024-06-28T20:23:03.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46773 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50424 req_id = 976afeea-a141-4cb7-beb7-77927967376b response_code = 204 uri = /switch-ports
16962024-06-28T20:23:03.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 719 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50424 req_id = 2477b5f3-7f84-4d4d-be77-39d0461aaf42 response_code = 200 uri = /network-bootstore-config
16972024-06-28T20:23:03.875ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42952
16982024-06-28T20:23:03.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44238 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42952 req_id = 311f03d0-0f9c-4f9d-9c39-bbb28e593715 response_code = 204 uri = /switch-ports
16992024-06-28T20:23:03.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42952 req_id = 32e3de24-b779-4d29-8bec-d012fa61fb06 response_code = 200 uri = /network-bootstore-config
17002024-06-28T20:23:06.333ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 372 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = d5d98d71-0d25-472c-a618-4a97861870be response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
17012024-06-28T20:23:20.731ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33634
17022024-06-28T20:23:20.732ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33634 req_id = 79511392-7db2-4289-902a-64197d9de21f response_code = 200 uri = /baseboard
17032024-06-28T20:23:33.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37080
17042024-06-28T20:23:33.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37080 req_id = 94ed02ed-adfe-49fc-b2a1-f1671a11216c response_code = 200 uri = /vpc-routes
17052024-06-28T20:23:33.674ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41396
17062024-06-28T20:23:33.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41396 req_id = 0279357b-cb80-4a22-8961-3aea4992fd53 response_code = 200 uri = /vpc-routes
17072024-06-28T20:23:33.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37080 req_id = 1c70f509-e1ae-43ed-9592-b7df2fe76d1e response_code = 204 uri = /vpc-routes
17082024-06-28T20:23:33.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41396 req_id = 7888ef34-57d1-4536-87af-b6f176648cc6 response_code = 204 uri = /vpc-routes
17092024-06-28T20:23:33.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63148
17102024-06-28T20:23:33.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63148 req_id = d1b2c517-d26b-4512-b079-ada71f8e6fd3 response_code = 200 uri = /v2p
17112024-06-28T20:23:33.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59568
17122024-06-28T20:23:33.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59568 req_id = d75080ee-94c4-4819-bc22-b94c27d7cf6a response_code = 200 uri = /vpc-routes
17132024-06-28T20:23:33.796ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52561
17142024-06-28T20:23:33.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52561 req_id = 66eac268-19ff-47c9-b1ae-c1cb19617ea7 response_code = 200 uri = /v2p
17152024-06-28T20:23:33.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59568 req_id = b5dcbde1-9857-4d5e-b674-f19d262399f1 response_code = 204 uri = /vpc-routes
17162024-06-28T20:23:33.821ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:831
17172024-06-28T20:23:33.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34018
17182024-06-28T20:23:33.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34018 req_id = 51dca882-7155-4e00-a870-43a9281ec202 response_code = 200 uri = /v2p
17192024-06-28T20:23:33.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44209
17202024-06-28T20:23:34.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47374 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44209 req_id = 4518cd23-7a6b-4c11-9510-0952589f1efd response_code = 204 uri = /switch-ports
17212024-06-28T20:23:34.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48049
17222024-06-28T20:23:34.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3402 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44209 req_id = 4ec8bb23-f21a-40c2-8784-b46e13c99acc response_code = 200 uri = /network-bootstore-config
17232024-06-28T20:23:34.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55404
17242024-06-28T20:23:34.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48049 req_id = f6913e53-d330-4089-9b3e-7bfdc9db2be2 response_code = 204 uri = /switch-ports
17252024-06-28T20:23:34.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 438 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48049 req_id = eda82ffc-0761-4c7b-87cc-7c133b61823c response_code = 200 uri = /network-bootstore-config
17262024-06-28T20:23:34.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 94381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55404 req_id = ffc6f3a7-45b7-4170-982c-354fe3a86f6f response_code = 204 uri = /switch-ports
17272024-06-28T20:23:34.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55404 req_id = 6b715319-ef22-4162-976b-9e89e53dedfe response_code = 200 uri = /network-bootstore-config
17282024-06-28T20:23:36.398ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 591 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 3c14bf33-6f2f-4fe1-a68c-90458808c8cf response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
17292024-06-28T20:23:50.764ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40213
17302024-06-28T20:23:50.764ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40213 req_id = 3ffa5b64-0ab3-4a41-9a6e-15d8147c36cf response_code = 200 uri = /baseboard
17312024-06-28T20:24:03.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55261
17322024-06-28T20:24:03.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55261 req_id = e49ccdc2-4228-4e51-bb93-9a2e3d80d4cb response_code = 200 uri = /vpc-routes
17332024-06-28T20:24:03.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55261 req_id = d28e8136-e48a-4bbd-af9b-b2d9af087f0b response_code = 204 uri = /vpc-routes
17342024-06-28T20:24:03.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50442
17352024-06-28T20:24:03.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50442 req_id = 30c35c7e-c581-491e-b5a9-c6d9dcdc0b4a response_code = 200 uri = /v2p
17362024-06-28T20:24:03.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43801
17372024-06-28T20:24:03.620ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43801 req_id = af9b1bbb-fb59-4e40-9dc0-c96c9ff34e3d response_code = 200 uri = /vpc-routes
17382024-06-28T20:24:03.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43801 req_id = 879f8df7-7dc1-42b5-9ea1-4cf5901a6ed9 response_code = 204 uri = /vpc-routes
17392024-06-28T20:24:03.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60897
17402024-06-28T20:24:03.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60897 req_id = cb6d0215-215e-44af-878c-66e69debf72b response_code = 200 uri = /vpc-routes
17412024-06-28T20:24:03.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60897 req_id = 8459e05d-d987-4ede-ab14-e654c8985a2a response_code = 204 uri = /vpc-routes
17422024-06-28T20:24:03.659ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36629
17432024-06-28T20:24:03.659ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36629 req_id = 23ec2a35-08fa-498f-b44b-ce05e8e8e450 response_code = 200 uri = /v2p
17442024-06-28T20:24:03.665ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50019
17452024-06-28T20:24:03.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50019 req_id = e293f151-4ce3-4a8b-b2f5-365152a55e91 response_code = 200 uri = /v2p
17462024-06-28T20:24:03.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38106
17472024-06-28T20:24:03.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50919 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38106 req_id = a121f9bc-6a5e-4db6-ac27-ef9bbbba9a81 response_code = 204 uri = /switch-ports
17482024-06-28T20:24:03.770ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46252
17492024-06-28T20:24:03.770ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38106 req_id = 7034ff84-a208-4af9-8baa-125affa54ecd response_code = 200 uri = /network-bootstore-config
17502024-06-28T20:24:03.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50808
17512024-06-28T20:24:03.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43621 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46252 req_id = 7e4e5324-49c3-4307-8724-5866818cadb4 response_code = 204 uri = /switch-ports
17522024-06-28T20:24:03.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 555 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46252 req_id = 8f5c233d-aed8-482d-bce8-99d731c4d1f9 response_code = 200 uri = /network-bootstore-config
17532024-06-28T20:24:03.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 79731 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50808 req_id = 0c19c24e-5a3b-4f26-85d4-31a6b34a9043 response_code = 204 uri = /switch-ports
17542024-06-28T20:24:03.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 862 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50808 req_id = 1cf73b11-80aa-4559-b72c-ba6ef86e2b31 response_code = 200 uri = /network-bootstore-config
17552024-06-28T20:24:06.399ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 509 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 56090e6c-efd9-4242-815b-87aaf546c343 response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
17562024-06-28T20:24:20.803ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55041
17572024-06-28T20:24:20.803ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55041 req_id = 7420b986-c3f3-40c4-a61f-55c16ef638ab response_code = 200 uri = /baseboard
17582024-06-28T20:24:33.621ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35055
17592024-06-28T20:24:33.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35055 req_id = 3b61f363-39e5-4706-9639-689bf8eef0db response_code = 200 uri = /vpc-routes
17602024-06-28T20:24:33.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35055 req_id = 08a91a16-ef71-4d2f-b172-874abec44c94 response_code = 204 uri = /vpc-routes
17612024-06-28T20:24:33.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57332
17622024-06-28T20:24:33.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57332 req_id = cbf566c4-4b0e-4e0a-8a15-86d061cc07d1 response_code = 200 uri = /vpc-routes
17632024-06-28T20:24:33.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57332 req_id = a757fc67-2e4e-4c0a-a4a1-9505226baa8e response_code = 204 uri = /vpc-routes
17642024-06-28T20:24:33.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52723
17652024-06-28T20:24:33.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52723 req_id = a5c93021-77b1-4bc0-99be-1339b914decb response_code = 200 uri = /v2p
17662024-06-28T20:24:33.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34968
17672024-06-28T20:24:33.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34968 req_id = 7c0255c1-19cd-4791-8af6-c439a8068571 response_code = 200 uri = /v2p
17682024-06-28T20:24:33.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43743
17692024-06-28T20:24:33.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43743 req_id = 58797ac3-3802-4a6b-ba97-7ff01037647a response_code = 200 uri = /v2p
17702024-06-28T20:24:33.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41458
17712024-06-28T20:24:33.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41458 req_id = b1910de5-b137-400f-95b2-b2db8bd6a343 response_code = 200 uri = /vpc-routes
17722024-06-28T20:24:33.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41458 req_id = 07cd3ccc-5a7e-45d0-9108-fb0c40f9cb7c response_code = 204 uri = /vpc-routes
17732024-06-28T20:24:33.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48148
17742024-06-28T20:24:33.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56045
17752024-06-28T20:24:33.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64379
17762024-06-28T20:24:34.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48842 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48148 req_id = 34253c41-4402-4535-8283-9b6b7b3a40db response_code = 204 uri = /switch-ports
17772024-06-28T20:24:34.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 654 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48148 req_id = b2878b76-d744-472e-b9c8-2649e41c695e response_code = 200 uri = /network-bootstore-config
17782024-06-28T20:24:34.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 92630 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56045 req_id = dcfabfc9-d05a-44d1-befd-c58357ef45fe response_code = 204 uri = /switch-ports
17792024-06-28T20:24:34.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 572 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56045 req_id = 4be47796-b69e-4b50-b395-452a6d6198f8 response_code = 200 uri = /network-bootstore-config
17802024-06-28T20:24:34.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 111376 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64379 req_id = d7042e52-aca7-4513-a114-b259ee7edfbd response_code = 204 uri = /switch-ports
17812024-06-28T20:24:34.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64379 req_id = 244a48e4-b068-4bce-b6c9-dd06d58c294e response_code = 200 uri = /network-bootstore-config
17822024-06-28T20:24:36.399ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 619 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 9ea13c95-192a-4520-b8b2-6cbdb7ac048f response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
17832024-06-28T20:24:50.835ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59276
17842024-06-28T20:24:50.835ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59276 req_id = 3b87de7d-1ccb-42e0-b5c8-8a126e1067be response_code = 200 uri = /baseboard
17852024-06-28T20:25:03.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33566
17862024-06-28T20:25:03.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33566 req_id = e8774d61-96f3-4de5-aab0-585aeedd48c4 response_code = 200 uri = /vpc-routes
17872024-06-28T20:25:03.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33566 req_id = ad61a4a9-7ddb-488a-9b51-0de489210004 response_code = 204 uri = /vpc-routes
17882024-06-28T20:25:03.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56641
17892024-06-28T20:25:03.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56641 req_id = 9720d06b-a32a-49e8-8db2-0fedaa0ef2cb response_code = 200 uri = /v2p
17902024-06-28T20:25:03.588ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51193
17912024-06-28T20:25:03.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1051 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51193 req_id = 047e2864-e1cc-4df5-a030-e57def0eddce response_code = 200 uri = /vpc-routes
17922024-06-28T20:25:03.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54155
17932024-06-28T20:25:03.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54155 req_id = 3a5791ae-6f9e-4662-b3a9-4446047fd030 response_code = 200 uri = /v2p
17942024-06-28T20:25:03.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51193 req_id = a43544eb-2a56-4a54-8ff1-18f000f7cfa0 response_code = 204 uri = /vpc-routes
17952024-06-28T20:25:03.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37548
17962024-06-28T20:25:03.610ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37548 req_id = 8b1b9dae-a573-4d7d-9353-f1f519cc47c2 response_code = 200 uri = /vpc-routes
17972024-06-28T20:25:03.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37548 req_id = 7c619a43-adea-43f8-8cf6-db44b9c746cd response_code = 204 uri = /vpc-routes
17982024-06-28T20:25:03.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45911
17992024-06-28T20:25:03.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45911 req_id = 7c512554-06e1-48e4-8cec-3a66e6390721 response_code = 200 uri = /v2p
18002024-06-28T20:25:03.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57713
18012024-06-28T20:25:03.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 48046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57713 req_id = f124d20f-c9c7-473e-be74-51a39ea346c8 response_code = 204 uri = /switch-ports
18022024-06-28T20:25:03.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38296
18032024-06-28T20:25:03.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36906
18042024-06-28T20:25:03.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57713 req_id = 6aceac75-2b86-4606-b4d7-c5cec4e7c0d3 response_code = 200 uri = /network-bootstore-config
18052024-06-28T20:25:03.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 44335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36906 req_id = 4c790d13-64f1-4a7f-ad76-e66aaecec338 response_code = 204 uri = /switch-ports
18062024-06-28T20:25:03.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36906 req_id = 848d121f-096b-4c59-8e95-6046111e7827 response_code = 200 uri = /network-bootstore-config
18072024-06-28T20:25:03.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 88861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38296 req_id = 0d89fdbe-0812-4d29-94e3-12f8f010d4d1 response_code = 204 uri = /switch-ports
18082024-06-28T20:25:03.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38296 req_id = c99515e0-6b3a-4518-b0dd-5816da1f092e response_code = 200 uri = /network-bootstore-config
18092024-06-28T20:25:06.399ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 720 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 391d8bf8-7d56-46d2-b770-5cce88ea4629 response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
18102024-06-28T20:25:20.867ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48211
18112024-06-28T20:25:20.867ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48211 req_id = b72617b2-165b-41cc-84b5-a1b55038d7da response_code = 200 uri = /baseboard
18122024-06-28T20:25:33.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50889
18132024-06-28T20:25:33.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50889 req_id = de8e2b19-e2a6-4a82-890d-9c3c74a3106a response_code = 200 uri = /vpc-routes
18142024-06-28T20:25:33.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50889 req_id = 9909ec60-f396-41de-b283-612a5189256a response_code = 204 uri = /vpc-routes
18152024-06-28T20:25:33.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60708
18162024-06-28T20:25:33.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60708 req_id = 11b79af7-22e6-4858-95e6-85bd5b6c5058 response_code = 200 uri = /vpc-routes
18172024-06-28T20:25:33.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60708 req_id = fecd16af-9a67-4176-b545-7f01a4748980 response_code = 204 uri = /vpc-routes
18182024-06-28T20:25:33.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52686
18192024-06-28T20:25:33.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52686 req_id = b1df183a-7fdc-447c-a960-9f54ad27b4f4 response_code = 200 uri = /v2p
18202024-06-28T20:25:33.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41318
18212024-06-28T20:25:33.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41318 req_id = 73e765d5-4c5c-4f88-9446-87a000150529 response_code = 200 uri = /vpc-routes
18222024-06-28T20:25:33.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46442
18232024-06-28T20:25:33.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46442 req_id = c903d75c-c6b5-48c1-91aa-0ff7a9a30477 response_code = 200 uri = /v2p
18242024-06-28T20:25:33.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41318 req_id = 2cfd246b-dd71-413f-a17d-8c8c025271fe response_code = 204 uri = /vpc-routes
18252024-06-28T20:25:33.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40693
18262024-06-28T20:25:33.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1424 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40693 req_id = 31929d87-5070-487c-bb81-afda482d9029 response_code = 200 uri = /v2p
18272024-06-28T20:25:33.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37964
18282024-06-28T20:25:33.830ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:725 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3784a80e-4ca5-4f13-872e-b0c3f0386cb2, kind: Service { id: 822a6774-7180-42fa-b51d-f435fb7cb390 }, name: Name("external-dns-822a6774-7180-42fa-b51d-f435fb7cb390"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4a25946c-409b-4dd7-b387-5787a229c6cd, kind: Service { id: af471492-15f5-4f5e-8e86-1a6f5fed1194 }, name: Name("external-dns-af471492-15f5-4f5e-8e86-1a6f5fed1194"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 36efc940-600c-4377-bde8-924b208bd6df, kind: Service { id: 2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d }, name: Name("nexus-2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a68d6849-d9e0-466b-ac4f-07da426a0fcd, kind: Service { id: 106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a }, name: Name("nexus-106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa47896d-e04d-4f67-8af5-28d86a4805bb, kind: Service { id: 6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 }, name: Name("nexus-6f5d9265-ef8a-4911-9c83-53b3e7aa91b8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18292024-06-28T20:25:33.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18302024-06-28T20:25:33.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18312024-06-28T20:25:33.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18322024-06-28T20:25:33.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18332024-06-28T20:25:33.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte0" rules = []
18342024-06-28T20:25:33.830ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18352024-06-28T20:25:33.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37964 req_id = 14c175e2-82c9-405f-a3ce-d7c2e35eaf07 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18362024-06-28T20:25:33.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61358
18372024-06-28T20:25:33.935ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:725 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3784a80e-4ca5-4f13-872e-b0c3f0386cb2, kind: Service { id: 822a6774-7180-42fa-b51d-f435fb7cb390 }, name: Name("external-dns-822a6774-7180-42fa-b51d-f435fb7cb390"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4a25946c-409b-4dd7-b387-5787a229c6cd, kind: Service { id: af471492-15f5-4f5e-8e86-1a6f5fed1194 }, name: Name("external-dns-af471492-15f5-4f5e-8e86-1a6f5fed1194"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 36efc940-600c-4377-bde8-924b208bd6df, kind: Service { id: 2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d }, name: Name("nexus-2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a68d6849-d9e0-466b-ac4f-07da426a0fcd, kind: Service { id: 106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a }, name: Name("nexus-106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa47896d-e04d-4f67-8af5-28d86a4805bb, kind: Service { id: 6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 }, name: Name("nexus-6f5d9265-ef8a-4911-9c83-53b3e7aa91b8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18382024-06-28T20:25:33.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18392024-06-28T20:25:33.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18402024-06-28T20:25:33.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18412024-06-28T20:25:33.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18422024-06-28T20:25:33.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte0" rules = []
18432024-06-28T20:25:33.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18442024-06-28T20:25:33.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1451 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61358 req_id = e89ffad2-b91b-4dfb-9cde-cd0327524e63 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18452024-06-28T20:25:33.963ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33822
18462024-06-28T20:25:33.963ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:725 rules = [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 3784a80e-4ca5-4f13-872e-b0c3f0386cb2, kind: Service { id: 822a6774-7180-42fa-b51d-f435fb7cb390 }, name: Name("external-dns-822a6774-7180-42fa-b51d-f435fb7cb390"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 214, 48])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4a25946c-409b-4dd7-b387-5787a229c6cd, kind: Service { id: af471492-15f5-4f5e-8e86-1a6f5fed1194 }, name: Name("external-dns-af471492-15f5-4f5e-8e86-1a6f5fed1194"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 220])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 36efc940-600c-4377-bde8-924b208bd6df, kind: Service { id: 2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d }, name: Name("nexus-2e82f68f-7fac-4e0d-ac4c-fce8477c3e5d"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a68d6849-d9e0-466b-ac4f-07da426a0fcd, kind: Service { id: 106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a }, name: Name("nexus-106b14c6-7c9e-4d84-9cb5-1e46cf3adc3a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 216])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fa47896d-e04d-4f67-8af5-28d86a4805bb, kind: Service { id: 6f5d9265-ef8a-4911-9c83-53b3e7aa91b8 }, name: Name("nexus-6f5d9265-ef8a-4911-9c83-53b3e7aa91b8"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18472024-06-28T20:25:33.963ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18482024-06-28T20:25:33.963ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18492024-06-28T20:25:33.963ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18502024-06-28T20:25:33.963ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18512024-06-28T20:25:33.964ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte0" rules = []
18522024-06-28T20:25:33.964ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:744 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18532024-06-28T20:25:33.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33822 req_id = 15ea417f-74a6-4928-8401-542f166eaac0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18542024-06-28T20:25:33.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33078
18552024-06-28T20:25:34.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33078 req_id = b83c14ce-7510-41d4-b398-657aabe14d74 response_code = 204 uri = /switch-ports
18562024-06-28T20:25:34.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43139
18572024-06-28T20:25:34.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33078 req_id = 823f4e52-c513-4a73-bfda-3ef1a7f2b0a2 response_code = 200 uri = /network-bootstore-config
18582024-06-28T20:25:34.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45001 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43139 req_id = 36ef5771-a328-4083-bd61-197f276bd185 response_code = 204 uri = /switch-ports
18592024-06-28T20:25:34.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43139 req_id = 411bdb7c-34ca-41bd-972f-5b9a9f5757d8 response_code = 200 uri = /network-bootstore-config
18602024-06-28T20:25:34.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41343
18612024-06-28T20:25:34.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41343 req_id = d6081389-d346-47a1-b456-dcec3d9fe8bf response_code = 204 uri = /switch-ports
18622024-06-28T20:25:34.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41343 req_id = 1f5acc92-8bdb-4660-b781-b6852f152e8e response_code = 200 uri = /network-bootstore-config
18632024-06-28T20:25:36.399ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 679 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 8e691942-c5ac-4500-a55f-7435dba53256 response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
18642024-06-28T20:25:50.899ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43576
18652024-06-28T20:25:50.899ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 47 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43576 req_id = 13bfc825-309c-4e1c-85e0-68ee20767020 response_code = 200 uri = /baseboard
18662024-06-28T20:26:03.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60162
18672024-06-28T20:26:03.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60162 req_id = 0f2f5894-c4c6-4d32-92ce-787ee17c74cc response_code = 200 uri = /vpc-routes
18682024-06-28T20:26:03.551ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60162 req_id = 7e537c5d-18bc-4f75-8089-858f08195569 response_code = 204 uri = /vpc-routes
18692024-06-28T20:26:03.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53955
18702024-06-28T20:26:03.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53955 req_id = c2dae859-508d-4d0a-bb9b-1f6ec389c1ae response_code = 200 uri = /v2p
18712024-06-28T20:26:03.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50322
18722024-06-28T20:26:03.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50322 req_id = f68d153d-6a40-4b07-9174-e0472a078bbf response_code = 200 uri = /vpc-routes
18732024-06-28T20:26:03.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50322 req_id = 3144486e-5a5e-4f13-8113-1e75fa66fb94 response_code = 204 uri = /vpc-routes
18742024-06-28T20:26:03.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59680
18752024-06-28T20:26:03.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59680 req_id = 00ce487f-03dc-4e52-b1bf-25b24c7e86ed response_code = 200 uri = /vpc-routes
18762024-06-28T20:26:03.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59680 req_id = 44fc63c3-9c9d-45f2-b8b9-bce9fe3489ac response_code = 204 uri = /vpc-routes
18772024-06-28T20:26:03.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42819
18782024-06-28T20:26:03.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42819 req_id = 9d4e87af-ce3a-42f6-b3f9-f643993259cb response_code = 200 uri = /v2p
18792024-06-28T20:26:03.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51478
18802024-06-28T20:26:03.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51478 req_id = 7831dddd-e8b4-481c-8cdc-6911373d79e2 response_code = 200 uri = /v2p
18812024-06-28T20:26:03.696ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39796
18822024-06-28T20:26:03.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49674 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39796 req_id = 941d0b70-cf1a-4fb3-83d6-c9b0797c7904 response_code = 204 uri = /switch-ports
18832024-06-28T20:26:03.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65072
18842024-06-28T20:26:03.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3585 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39796 req_id = aa8ccc61-ec03-40bb-b364-30e5740bd013 response_code = 200 uri = /network-bootstore-config
18852024-06-28T20:26:03.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34051
18862024-06-28T20:26:03.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 46879 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65072 req_id = 5639711f-9ca0-4239-9a11-06458a9c2975 response_code = 204 uri = /switch-ports
18872024-06-28T20:26:03.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 618 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65072 req_id = 73bfa727-6f01-4e89-9c4f-efa6e00d6139 response_code = 200 uri = /network-bootstore-config
18882024-06-28T20:26:03.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 64324 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34051 req_id = b6075f6b-ac0b-434c-8a49-6c8071d7bc1a response_code = 204 uri = /switch-ports
18892024-06-28T20:26:03.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34051 req_id = 101e906a-8992-4d5f-a0ec-c6f563480810 response_code = 200 uri = /network-bootstore-config
18902024-06-28T20:26:06.496ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3287 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 914f116c-6b79-4135-a8f8-3d60a85e62fe response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
18912024-06-28T20:26:20.931ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37509
18922024-06-28T20:26:20.931ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37509 req_id = 6da6c363-48f8-4dba-8235-d33cd8052892 response_code = 200 uri = /baseboard
18932024-06-28T20:26:33.622ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34487
18942024-06-28T20:26:33.622ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34487 req_id = ed128e05-f7e4-46d1-afa2-6376298b6502 response_code = 200 uri = /v2p
18952024-06-28T20:26:33.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53349
18962024-06-28T20:26:33.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53349 req_id = 2c6629b7-4141-4d33-ae2f-0fd410ff2ce5 response_code = 200 uri = /vpc-routes
18972024-06-28T20:26:33.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35801
18982024-06-28T20:26:33.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35801 req_id = a2365f35-b043-43b1-86dc-d01041dd22fd response_code = 200 uri = /vpc-routes
18992024-06-28T20:26:33.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53349 req_id = 8d637e0c-7c82-47cf-a685-f924420343b6 response_code = 204 uri = /vpc-routes
19002024-06-28T20:26:33.641ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35801 req_id = b8510139-10ad-406d-9b75-669f2fc16f5f response_code = 204 uri = /vpc-routes
19012024-06-28T20:26:33.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36414
19022024-06-28T20:26:33.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36414 req_id = b5695aae-b71f-4981-b2dd-1f8a7bdc428a response_code = 200 uri = /v2p
19032024-06-28T20:26:33.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62570
19042024-06-28T20:26:33.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62570 req_id = 090008fe-9ee3-44af-bbd6-12664ef2c67a response_code = 200 uri = /vpc-routes
19052024-06-28T20:26:33.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49554
19062024-06-28T20:26:33.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1031 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49554 req_id = 80f34e83-b47a-4fdf-887c-13c8eb1786aa response_code = 200 uri = /v2p
19072024-06-28T20:26:33.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62570 req_id = 82838592-fed6-4e10-b9b7-e91ae1949144 response_code = 204 uri = /vpc-routes
19082024-06-28T20:26:33.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40829
19092024-06-28T20:26:33.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 50877 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40829 req_id = e7991b1d-f411-445f-87b4-01c77f7b4ef4 response_code = 204 uri = /switch-ports
19102024-06-28T20:26:33.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47461
19112024-06-28T20:26:33.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 3825 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40829 req_id = e4cedea1-72a7-4f63-b04c-24d7fd2625b3 response_code = 200 uri = /network-bootstore-config
19122024-06-28T20:26:34.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48253
19132024-06-28T20:26:34.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45717 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47461 req_id = 36b89e79-3a01-4336-985b-e4fd535bcdfb response_code = 204 uri = /switch-ports
19142024-06-28T20:26:34.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 974 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47461 req_id = b5d0524e-363a-4fef-94d8-0719ef37335c response_code = 200 uri = /network-bootstore-config
19152024-06-28T20:26:34.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 64711 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48253 req_id = a029f36d-192c-46d7-895c-0049b390f585 response_code = 204 uri = /switch-ports
19162024-06-28T20:26:34.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48253 req_id = f2e626e2-8b12-4757-966e-b93fe8b6c6ab response_code = 200 uri = /network-bootstore-config
19172024-06-28T20:26:36.494ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1340 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 57bb64ea-0535-4d0f-9f70-c8d0b8342366 response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
19182024-06-28T20:26:50.966ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32978
19192024-06-28T20:26:50.966ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 114 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32978 req_id = 19070d76-1d84-40db-93d1-71e5af4eb96f response_code = 200 uri = /baseboard
19202024-06-28T20:27:03.541ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42027
19212024-06-28T20:27:03.541ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42027 req_id = 31bb850b-f6a7-46ea-bbc6-665a6ee61c7c response_code = 200 uri = /vpc-routes
19222024-06-28T20:27:03.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42027 req_id = 13a7c0ef-554a-422f-be3f-f3a4cfe36700 response_code = 204 uri = /vpc-routes
19232024-06-28T20:27:03.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47433
19242024-06-28T20:27:03.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47433 req_id = 749c0710-a040-4405-b4b1-e51dafd1c73f response_code = 200 uri = /v2p
19252024-06-28T20:27:03.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59192
19262024-06-28T20:27:03.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59192 req_id = 5efdd3d2-eae4-4726-b2fe-5bba26d0fa1e response_code = 200 uri = /vpc-routes
19272024-06-28T20:27:03.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59192 req_id = c93858ae-9088-46a8-93f7-632633962351 response_code = 204 uri = /vpc-routes
19282024-06-28T20:27:03.583ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61074
19292024-06-28T20:27:03.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61074 req_id = ac6be02f-a72c-4867-a992-e9da09ebf800 response_code = 200 uri = /v2p
19302024-06-28T20:27:03.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55555
19312024-06-28T20:27:03.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55555 req_id = c10ea746-ecc1-49f4-b601-4e16277106b0 response_code = 200 uri = /vpc-routes
19322024-06-28T20:27:03.608ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55555 req_id = 91b52859-e109-41b4-beb3-ee2cb40ecba7 response_code = 204 uri = /vpc-routes
19332024-06-28T20:27:03.652ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57983
19342024-06-28T20:27:03.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57983 req_id = e9395489-aa2c-473a-9c63-f0ff96bd9c58 response_code = 200 uri = /v2p
19352024-06-28T20:27:03.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48517
19362024-06-28T20:27:03.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 51465 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48517 req_id = 2f6fa7b5-6064-4ca3-85b0-c6de0fd800c3 response_code = 204 uri = /switch-ports
19372024-06-28T20:27:03.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48517 req_id = ce5dbb25-6219-4382-9289-c20b4cd67fc5 response_code = 200 uri = /network-bootstore-config
19382024-06-28T20:27:03.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58876
19392024-06-28T20:27:03.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 45221 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58876 req_id = fb6af17e-8c71-4cf3-a797-cdc1c480b9e5 response_code = 204 uri = /switch-ports
19402024-06-28T20:27:03.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 703 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58876 req_id = ea1fcecb-dbce-4f26-940f-463c1d590c17 response_code = 200 uri = /network-bootstore-config
19412024-06-28T20:27:03.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51817
19422024-06-28T20:27:03.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 43531 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51817 req_id = eb58bcb0-4dbf-48fd-99e3-eefaf0de334d response_code = 204 uri = /switch-ports
19432024-06-28T20:27:03.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51817 req_id = d6d8f87c-96a4-40ae-af74-b6feb85249eb response_code = 200 uri = /network-bootstore-config
19442024-06-28T20:27:03.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33967
19452024-06-28T20:27:03.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 902 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33967 req_id = 0f537643-0265-44ba-86a6-7d9451a8d86e response_code = 200 uri = /v2p
19462024-06-28T20:27:03.901ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9572729) }
19472024-06-28T20:27:03.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33967 req_id = ed7058ea-1783-4a99-805a-066a4179c0e6 response_code = 204 uri = /v2p
19482024-06-28T20:27:04.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48700
19492024-06-28T20:27:04.066ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:548 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 1ff72a8c-6c01-4768-bee1-69c301fdcbbf, kind: Instance { id: 92361701-b930-4bf7-9e39-2671270bc891 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9572729), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1ff72a8c-6c01-4768-bee1-69c301fdcbbf, kind: Instance { id: 92361701-b930-4bf7-9e39-2671270bc891 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9572729), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1ff72a8c-6c01-4768-bee1-69c301fdcbbf, kind: Instance { id: 92361701-b930-4bf7-9e39-2671270bc891 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9572729), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9572729))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1ff72a8c-6c01-4768-bee1-69c301fdcbbf, kind: Instance { id: 92361701-b930-4bf7-9e39-2671270bc891 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9572729), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-68b64c288ec", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: c865511b-eb2c-475e-b465-1268850eedef, read_only_parent: Some(Volume { block_size: 512, id: 16f7c361-6ef1-40f4-945c-07d724e2edd8, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6c61e462-806c-4291-b2c7-0f357ba4c1d8, key: Some("qxhpBq4h71RZ5+jzr2aIrxoJGGWi6e0oquwQ/RAUn9U="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c865511b-eb2c-475e-b465-1268850eedef, key: Some("qwgI5yuGkqIK3NZ1UATY8/lex0GVuMBDN4QDzMsDDNU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAABYqPcWNxYAABio9xYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAAmKj3FjcWAAAYqPcWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI5MjM2MTcwMS1iOTMwLTRiZjctOWUzOS0yNjcxMjcwYmM4OTEiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJUE81M1FTQ1R4eURjWXdsVDlCU0JZbC9oUEd4ZW5hd1dVa0RGbnZmZFNVUyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") } instance_id = 92361701-b930-4bf7-9e39-2671270bc891 instance_runtime = InstanceRuntimeState { propolis_id: Some(68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-28T20:27:03.611367785Z } metadata = InstanceMetadata { silo_id: fb585769-7e66-49a5-8002-674a922272dd, project_id: ef18d184-737d-4085-b746-1feda7bc285c } propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 68fb1eda-2f2a-4861-9027-ff33fa10ff60 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-28T20:27:03.548519Z }
19502024-06-28T20:27:04.066ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:582 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 (instance)
19512024-06-28T20:27:04.067ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:942 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 propolis_id = 68fb1eda-2f2a-4861-9027-ff33fa10ff60 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 1ff72a8c-6c01-4768-bee1-69c301fdcbbf, kind: Instance { id: 92361701-b930-4bf7-9e39-2671270bc891 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9572729), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1ff72a8c-6c01-4768-bee1-69c301fdcbbf, kind: Instance { id: 92361701-b930-4bf7-9e39-2671270bc891 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9572729), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1ff72a8c-6c01-4768-bee1-69c301fdcbbf, kind: Instance { id: 92361701-b930-4bf7-9e39-2671270bc891 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9572729), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9572729))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, VpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1ff72a8c-6c01-4768-bee1-69c301fdcbbf, kind: Instance { id: 92361701-b930-4bf7-9e39-2671270bc891 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9572729), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-68b64c288ec", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: c865511b-eb2c-475e-b465-1268850eedef, read_only_parent: Some(Volume { block_size: 512, id: 16f7c361-6ef1-40f4-945c-07d724e2edd8, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6c61e462-806c-4291-b2c7-0f357ba4c1d8, key: Some("qxhpBq4h71RZ5+jzr2aIrxoJGGWi6e0oquwQ/RAUn9U="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c865511b-eb2c-475e-b465-1268850eedef, key: Some("qwgI5yuGkqIK3NZ1UATY8/lex0GVuMBDN4QDzMsDDNU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::14]:19000"] } }] } }], cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAABYqPcWNxYAABio9xYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAAmKj3FjcWAAAYqPcWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI5MjM2MTcwMS1iOTMwLTRiZjctOWUzOS0yNjcxMjcwYmM4OTEiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJUE81M1FTQ1R4eURjWXdsVDlCU0JZbC9oUEd4ZW5hd1dVa0RGbnZmZFNVUyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA") }, instance_runtime: InstanceRuntimeState { propolis_id: Some(68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-28T20:27:03.611367785Z }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(1), time_updated: 2024-06-28T20:27:03.548519Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400 }
19522024-06-28T20:27:04.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 10306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48700 req_id = c44b34f6-fd03-486f-9dbd-79bfd9beedf0 response_code = 200 uri = /instances/92361701-b930-4bf7-9e39-2671270bc891
19532024-06-28T20:27:04.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41461
19542024-06-28T20:27:04.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 2331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41461 req_id = e6362924-709e-4822-975b-ea02f8689d00 response_code = 200 uri = /instances/92361701-b930-4bf7-9e39-2671270bc891/state
19552024-06-28T20:27:04.219ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:478 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 243, 228, 36]), slot: 0, vni: Vni { inner: 9572729 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 }, vnic: "vopte6" }) }
19562024-06-28T20:27:04.220ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
19572024-06-28T20:27:04.253ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60 file = illumos-utils/src/zone.rs:315 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19582024-06-28T20:27:04.274ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60 file = illumos-utils/src/zone.rs:354 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19592024-06-28T20:27:05.674ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value="oxControlInstance0"/> <propval type="astring" name="gateway" value="fd00:1122:3344:101::1"/> <propval type="astring" name="listen_addr" value="fd00:1122:3344:101::1:0"/> <propval type="astring" name="listen_port" value="12400"/> <propval type="astring" name="metric_addr" value="[fd00:1122:3344:101::a]:12221"/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19602024-06-28T20:27:05.674ZINFOSledAgent (InstanceManager): Zone booting file = illumos-utils/src/running_zone.rs:513 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19612024-06-28T20:27:05.844ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60") failed: Property not found. retry in 69.642482ms file = illumos-utils/src/svc.rs:36 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19622024-06-28T20:27:05.933ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60") failed: Property not found. retry in 62.311485ms file = illumos-utils/src/svc.rs:36 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19632024-06-28T20:27:06.016ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60") failed: Property not found. retry in 218.716684ms file = illumos-utils/src/svc.rs:36 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19642024-06-28T20:27:06.252ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60") failed: Property not found. retry in 557.80726ms file = illumos-utils/src/svc.rs:36 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19652024-06-28T20:27:06.494ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1071 local_addr = [fd00:1122:3344:101::1]:37179 method = GET remote_addr = [fd00:1122:3344:101::d]:47084 req_id = 0f5cc954-8d8c-4edb-94cf-8f891bb99114 response_code = 200 sled_id = e6aa3805-f338-41a1-9087-e851abde3933 uri = /e6aa3805-f338-41a1-9087-e851abde3933
19662024-06-28T20:27:06.821ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60") failed: Property not found. retry in 494.490214ms file = illumos-utils/src/svc.rs:36 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19672024-06-28T20:27:07.326ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60") failed: Property not found. retry in 674.991165ms file = illumos-utils/src/svc.rs:36 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19682024-06-28T20:27:08.011ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60") failed: Property not found. retry in 694.794529ms file = illumos-utils/src/svc.rs:36 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19692024-06-28T20:27:08.715ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60") failed: Property not found. retry in 1.357112999s file = illumos-utils/src/svc.rs:36 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19702024-06-28T20:27:10.082ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60") failed: Property not found. retry in 1.426844731s file = illumos-utils/src/svc.rs:36 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 zone = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
19712024-06-28T20:27:11.536ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60 file = sled-agent/src/instance.rs:1428 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19722024-06-28T20:27:11.544ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1437 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19732024-06-28T20:27:11.581ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1451 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19742024-06-28T20:27:11.582ZINFOSledAgent (InstanceManager): Sending ensure request to propolis: InstanceEnsureRequest { cloud_init_bytes: Some("6zyQTVNXSU40LjEAAgEBAAIAAioA+AEAKgBAAAAAAAAAAAAAAAApeFY0EmNpZGF0YSAgICAgRkFUMTIgICAOH75bfKwiwHQLVrQOuwcAzRBe6/Ay5M0WzRnr/lRoaXMgaXMgbm90IGEgYm9vdGFibGUgZGlzay4gIFBsZWFzZSBpbnNlcnQgYSBib290YWJsZSBmbG9wcHkgYW5kDQpwcmVzcyBhbnkga2V5IHRvIHRyeSBhZ2FpbiAuLi4gDQoAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAVar4////DwAAAAAAAAAA8P//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////D/j///8PAAAAAAAAAADw//////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////8PY2lkYXRhICAgICAIAAAAAAAAAAAAAAAAAAAAAAAAAABBbQBlAHQAYQAtAA8A1GQAYQB0AGEAAAD//wAA/////01FVEEtRH4xICAgAAABYqPcWNxYAABio9xYAgC3AAAAQXUAcwBlAHIALQAPALBkAGEAdABhAAAA//8AAP////9VU0VSLUR+MSAgIAAAAmKj3FjcWAAAYqPcWAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAHsiaW5zdGFuY2UtaWQiOiI5MjM2MTcwMS1iOTMwLTRiZjctOWUzOS0yNjcxMjcwYmM4OTEiLCJsb2NhbC1ob3N0bmFtZSI6ImxvY2Fsc2hhcmsiLCJwdWJsaWMta2V5cyI6WyJzc2gtZWQyNTUxOSBBQUFBQzNOemFDMWxaREkxTlRFNUFBQUFJUE81M1FTQ1R4eURjWXdsVDlCU0JZbC9oUEd4ZW5hd1dVa0RGbnZmZFNVUyJdfQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA"), disks: [DiskRequest { device: "nvme", name: "disk-68b64c288ec", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: c865511b-eb2c-475e-b465-1268850eedef, read_only_parent: Some(Volume { block_size: 512, id: 16f7c361-6ef1-40f4-945c-07d724e2edd8, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 6c61e462-806c-4291-b2c7-0f357ba4c1d8, key: Some("qxhpBq4h71RZ5+jzr2aIrxoJGGWi6e0oquwQ/RAUn9U="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::17]:19002", "[fd00:1122:3344:101::19]:19001", "[fd00:1122:3344:101::12]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: c865511b-eb2c-475e-b465-1268850eedef, key: Some("qwgI5yuGkqIK3NZ1UATY8/lex0GVuMBDN4QDzMsDDNU="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::19]:19002", "[fd00:1122:3344:101::12]:19002", "[fd00:1122:3344:101::14]:19000"] } }] } }], migrate: None, nics: [NetworkInterfaceRequest { name: "vopte6", slot: Slot(0) }], properties: InstanceProperties { bootrom_id: 00000000-0000-0000-0000-000000000000, description: "Test description", id: 92361701-b930-4bf7-9e39-2671270bc891, image_id: 00000000-0000-0000-0000-000000000000, memory: 1024, metadata: InstanceMetadata { project_id: ef18d184-737d-4085-b746-1feda7bc285c, silo_id: fb585769-7e66-49a5-8002-674a922272dd }, name: "localshark", vcpus: 2 } } file = sled-agent/src/instance.rs:689 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19752024-06-28T20:27:11.828ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:691 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19762024-06-28T20:27:11.830ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Starting), migration_status: NoMigration, time: 2024-06-28T20:27:11.830362745Z } file = sled-agent/src/instance.rs:573 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19772024-06-28T20:27:11.830ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 new_instance_state = InstanceRuntimeState { propolis_id: Some(68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-28T20:27:03.611367785Z } new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-28T20:27:11.830362745Z } propolis_id = 68fb1eda-2f2a-4861-9027-ff33fa10ff60
19782024-06-28T20:27:11.831ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-28T20:27:03.611367785Z }, propolis_id: 68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis), vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-06-28T20:27:11.830362745Z }, migration_state: None }
19792024-06-28T20:27:11.900ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_status: NoMigration, time: 2024-06-28T20:27:11.900959888Z } file = sled-agent/src/instance.rs:573 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19802024-06-28T20:27:11.901ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 new_instance_state = InstanceRuntimeState { propolis_id: Some(68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-28T20:27:03.611367785Z } new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-28T20:27:11.900959888Z } propolis_id = 68fb1eda-2f2a-4861-9027-ff33fa10ff60
19812024-06-28T20:27:11.901ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-28T20:27:03.611367785Z }, propolis_id: 68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis), vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-06-28T20:27:11.900959888Z }, migration_state: None }
19822024-06-28T20:27:11.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50648
19832024-06-28T20:27:11.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50648 req_id = 38d62b1c-4a5e-4a8f-847b-c1db169ef147 response_code = 200 uri = /vpc-routes
19842024-06-28T20:27:11.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50648 req_id = f5c6ba13-3531-4172-8e30-f5228ba8d21b response_code = 204 uri = /vpc-routes
19852024-06-28T20:27:12.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57112
19862024-06-28T20:27:12.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57112 req_id = 1ce7c124-476c-4254-8cf9-1fa4a9021d55 response_code = 200 uri = /vpc-routes
19872024-06-28T20:27:12.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 699 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57112 req_id = 72e3e691-500f-496e-a72e-80adf9cf17ac response_code = 204 uri = /vpc-routes
19882024-06-28T20:27:20.999ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:43364
19892024-06-28T20:27:20.999ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:43364 req_id = 02a565a1-36a0-4762-ac1c-a972df81b77e response_code = 200 uri = /baseboard
19902024-06-28T20:27:21.623ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36747
19912024-06-28T20:27:21.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 1531 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36747 req_id = 1f3d09af-ec8b-4a91-905c-03a9e88996fa response_code = 200 uri = /instances/92361701-b930-4bf7-9e39-2671270bc891/state
19922024-06-28T20:27:21.625ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_status: NoMigration, time: 2024-06-28T20:27:21.625261808Z } file = sled-agent/src/instance.rs:573 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19932024-06-28T20:27:21.625ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 new_instance_state = InstanceRuntimeState { propolis_id: Some(68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-28T20:27:03.611367785Z } new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-28T20:27:21.625261808Z } propolis_id = 68fb1eda-2f2a-4861-9027-ff33fa10ff60
19942024-06-28T20:27:21.625ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: Some(68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis)), dst_propolis_id: None, migration_id: None, gen: Generation(3), time_updated: 2024-06-28T20:27:03.611367785Z }, propolis_id: 68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis), vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-06-28T20:27:21.625261808Z }, migration_state: None }
19952024-06-28T20:27:21.669ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_status: NoMigration, time: 2024-06-28T20:27:21.669798538Z } file = sled-agent/src/instance.rs:573 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19962024-06-28T20:27:21.669ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:595 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 new_instance_state = InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-28T20:27:21.669798538Z } new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2024-06-28T20:27:21.669798538Z } propolis_id = 68fb1eda-2f2a-4861-9027-ff33fa10ff60
19972024-06-28T20:27:21.669ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:610 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
19982024-06-28T20:27:21.669ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
19992024-06-28T20:27:21.671ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:406
20002024-06-28T20:27:21.671ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/893e883e-0735-4681-80b4-298a478763ff/debug/bundle/zone", "/pool/int/8ab2c87c-d18e-4f1e-97bf-cdd6762da1a5/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/5ac4a919-8b24-423d-ad25-5b564847ba3f/crypt/debug", "/pool/ext/e2ec5a14-af67-4734-9131-7da5563a61e7/crypt/debug", "/pool/ext/d4198ec9-f3b5-46ff-8674-42aeb9de5463/crypt/debug", "/pool/ext/c1542ec6-6c29-4611-9b23-92e37a62d021/crypt/debug", "/pool/ext/fd3016d5-07c4-4b1e-9f22-6b003745d806/crypt/debug", "/pool/ext/ddccf8a3-466c-4983-9045-85a61a2f0cb5/crypt/debug", "/pool/ext/70d817e0-8838-4d86-ae6d-cb77ce8a3e35/crypt/debug", "/pool/ext/6adfb7f2-0d81-42e0-a47c-52d4c5bc9b11/crypt/debug", "/pool/ext/b1b0311e-24a0-4d3f-b298-78dc98cee0a2/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:437 zone_name = oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60
20012024-06-28T20:27:21.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52382
20022024-06-28T20:27:21.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52382 req_id = 3a015d17-1cfb-4a89-9cb6-8ce9b9324ace response_code = 200 uri = /vpc-routes
20032024-06-28T20:27:21.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 758 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52382 req_id = 1c52ae93-6808-43c7-9aea-ddd347323d93 response_code = 204 uri = /vpc-routes
20042024-06-28T20:27:22.289ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1230 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60", bundle_id: dfde6987-3df7-4cc9-a61c-134731a4f911 }, time_created: 2024-06-28T20:27:21.672056566Z, version: 0, cause: TerminatedInstance }
20052024-06-28T20:27:22.290ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_68fb1eda-2f2a-4861-9027-ff33fa10ff60 file = sled-agent/src/instance.rs:784 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
20062024-06-28T20:27:24.028ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:269 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
20072024-06-28T20:27:24.045ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:958 id = RouterId { vni: Vni(9572729), kind: System }
20082024-06-28T20:27:24.045ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:958 id = RouterId { vni: Vni(9572729), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
20092024-06-28T20:27:24.054ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-28T20:27:21.669798538Z }, propolis_id: 68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-28T20:27:24.054082132Z }, migration_state: None }
20102024-06-28T20:27:24.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33975
20112024-06-28T20:27:24.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33975 req_id = e67ceeeb-f2e0-4752-af7f-4ddbd473ae50 response_code = 200 uri = /v2p
20122024-06-28T20:27:24.181ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:832 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9572729) }
20132024-06-28T20:27:24.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33975 req_id = de72531e-0c4c-4c06-aed2-e874e8710038 response_code = 204 uri = /v2p
20142024-06-28T20:27:24.461ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:492 instance_id = 92361701-b930-4bf7-9e39-2671270bc891 state = SledInstanceState { instance_state: InstanceRuntimeState { propolis_id: None, dst_propolis_id: None, migration_id: None, gen: Generation(5), time_updated: 2024-06-28T20:27:21.669798538Z }, propolis_id: 68fb1eda-2f2a-4861-9027-ff33fa10ff60 (propolis), vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-06-28T20:27:24.054082132Z }, migration_state: None }
20152024-06-28T20:27:24.473ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:727 instance_id = 92361701-b930-4bf7-9e39-2671270bc891
20162024-06-28T20:27:24.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64383
20172024-06-28T20:27:24.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64383 req_id = 2574c338-f8f0-4580-9369-2a22d2012b54 response_code = 200 uri = /vpc-routes
20182024-06-28T20:27:24.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64383 req_id = 2907932a-1528-474d-99b7-c7e005af80f7 response_code = 204 uri = /vpc-routes
20192024-06-28T20:27:24.558ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47838
20202024-06-28T20:27:24.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 689 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47838 req_id = 0c1a2fc5-fec9-4e81-b11a-1e502fa1d520 response_code = 200 uri = /vpc-routes
20212024-06-28T20:27:24.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47838 req_id = 2192bc6a-fcf9-47c3-8ca7-85b0ca050eab response_code = 204 uri = /vpc-routes
20222024-06-28T20:27:25.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60495
20232024-06-28T20:27:25.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60495 req_id = 736f5ea6-df2e-449f-9a80-643b13defc08 response_code = 200 uri = /v2p
20242024-06-28T20:27:25.773ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:872 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 243, 228, 36])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9572729) }
20252024-06-28T20:27:25.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 726 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::a]:60495 req_id = 23602297-1d51-4ca3-8af9-229749daf02a response_code = 204 uri = /v2p
20262024-06-28T20:27:26.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:766 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44290
20272024-06-28T20:27:26.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 572 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44290 req_id = 3a2f4d2e-81fd-4b41-91b9-36afc7d1c4c8 response_code = 200 uri = /vpc-routes
20282024-06-28T20:27:26.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/0cd0e82/dropshot/src/server.rs:878 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44290 req_id = 0b15dbec-a756-4a27-86fb-441f0d34354b response_code = 204 uri = /vpc-routes